Zubnet AIसीखेंWiki › Convolution
मूल सिद्धांत

Convolution

Conv, Convolutional Layer, Kernel, Filter
एक mathematical operation जो local patterns detect करने के लिए एक input के across एक small filter (kernel) slide करती है। Images में, एक 3×3 kernel हर position के across slide करता है, underlying pixels के साथ dot product compute करते हुए एक feature map produce करने के लिए। Different kernels different patterns detect करते हैं: horizontal edges, vertical edges, textures, और eventually deeper layers में eyes या wheels जैसी complex features।

यह क्यों matter करता है

Convolution वो operation है जिसने computer vision को काम करवाया। ये दो powerful assumptions encode करती है: locality (nearby pixels related हैं) और translation equivariance (एक pattern same है चाहे वो कहीं भी appear करे)। ये assumptions fully connected layers के compared parameters की number को dramatically reduce करती हैं, high-resolution images process करना feasible बनाते हुए। Transformer era में भी, convolutions कई hybrid architectures में use होती हैं।

Deep Dive

A convolution with a 3×3 kernel: at each position, multiply the 9 kernel values with the 9 underlying input values and sum them. This produces one output value. Slide the kernel to the next position and repeat. A single kernel produces one feature map (detecting one pattern). Multiple kernels produce multiple feature maps. Stride (how far the kernel moves each step) and padding (how to handle edges) are additional parameters that control the output size.

Depth and Hierarchy

In a CNN, early layers use small kernels to detect simple patterns. Each subsequent layer convolves over the previous layer's feature maps, detecting progressively more complex patterns. Layer 1: edges. Layer 2: corners and textures (combinations of edges). Layer 3: object parts (combinations of textures). Layer 4: objects (combinations of parts). This hierarchical feature learning is the fundamental mechanism behind CNNs' success in vision.

1D and 3D Convolutions

Convolutions aren't limited to 2D images. 1D convolutions process sequences (audio waveforms, time series, text), sliding a kernel along one dimension. 3D convolutions process volumes (video, medical scans), sliding along three dimensions. The principle is identical: local pattern detection with parameter sharing. 1D convolutions are used in some modern architectures (ConvNeXt, Hyena) as efficient alternatives to attention for certain operations.

संबंधित अवधारणाएँ

← सभी Terms
ESC