https://arshadhs.github.io/tags/multi-core-cpu/Recent content in Multi-Core CPU on Arshad SiddiquiHugoen-ushttps://arshadhs.github.io/docs/ai/038-ml-system-optimisation/030-parallel-programming-models/Mon, 01 Jan 0001 00:00:00 +0000https://arshadhs.github.io/docs/ai/038-ml-system-optimisation/030-parallel-programming-models/<h1 id="parallel-programming-models"> Parallel Programming Models <a class="anchor" href="#parallel-programming-models">#</a> </h1> <p>Parallel algorithms need hardware that can execute independent work efficiently. Modern systems therefore combine multiple CPU cores, memory hierarchies, threads, instruction pipelines, GPUs, clusters, and specialised matrix processors.</p> <p>This page covers:</p> <ul> <li>multi-core CPU organisation</li> <li>cache and memory hierarchy</li> <li>processes, threads, scheduling, and synchronisation</li> <li>instruction pipelining and clock-cycle time</li> <li>SIMD, MIMD, and SIMT execution</li> <li>GPGPU architecture and GPU memory behaviour</li> <li>CPU-only and GPU-accelerated clusters</li> <li>Tensor Processing Units and systolic arrays</li> </ul> <h2 id="learning-objectives"> Learning Objectives <a class="anchor" href="#learning-objectives">#</a> </h2> <p>By the end of this page, you should be able to:</p>