1 / 17

Lecture: Large Caches, Virtual Memory

Lecture: Large Caches, Virtual Memory. Topics: cache innovations (Sections 2.4, B.4, B.5). Techniques to Reduce Cache Misses. Victim caches Better replacement policies – pseudo-LRU, NRU Prefetching, cache compression. Victim Caches. A direct-mapped cache suffers from misses because

jcolleen
Download Presentation

Lecture: Large Caches, Virtual Memory

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Lecture: Large Caches, Virtual Memory • Topics: cache innovations (Sections 2.4, B.4, B.5)

  2. Techniques to Reduce Cache Misses • Victim caches • Better replacement policies – pseudo-LRU, NRU • Prefetching, cache compression

  3. Victim Caches • A direct-mapped cache suffers from misses because multiple pieces of data map to the same location • The processor often tries to access data that it recently discarded – all discards are placed in a small victim cache (4 or 8 entries) – the victim cache is checked before going to L2 • Can be viewed as additional associativity for a few sets that tend to have the most conflicts

  4. Replacement Policies • Pseudo-LRU: maintain a tree and keep track of which side of the tree was touched more recently; simple bit ops • NRU: every block in a set has a bit; the bit is made zero when the block is touched; if all are zero, make all one; a block with bit set to 1 is evicted

  5. Prefetching • Hardware prefetching can be employed for any of the cache levels • It can introduce cache pollution – prefetched data is often placed in a separate prefetch buffer to avoid pollution – this buffer must be looked up in parallel with the cache access • Aggressive prefetching increases “coverage”, but leads to a reduction in “accuracy”  wasted memory bandwidth • Prefetches must be timely: they must be issued sufficiently in advance to hide the latency, but not too early (to avoid pollution and eviction before use)

  6. Stream Buffers • Simplest form of prefetch: on every miss, bring in multiple cache lines • When you read the top of the queue, bring in the next line L1 Sequential lines Stream buffer

  7. Stride-Based Prefetching • For each load, keep track of the last address accessed by the load and a possibly consistent stride • FSM detects consistent stride and issues prefetches incorrect init steady correct correct incorrect (update stride) PC tag prev_addr stride state correct correct trans no-pred incorrect (update stride) incorrect (update stride)

  8. Intel Montecito Cache Two cores, each with a private 12 MB L3 cache and 1 MB L2 Naffziger et al., Journal of Solid-State Circuits, 2006

  9. Intel 80-Core Prototype – Polaris Prototype chip with an entire die of SRAM cache stacked upon the cores

  10. Shared Vs. Private Caches in Multi-Core • What are the pros/cons to a shared L2 cache? P1 P2 P3 P4 P1 P2 P3 P4 L1 L1 L1 L1 L1 L1 L1 L1 L2 L2 L2 L2 L2

  11. Shared Vs. Private Caches in Multi-Core • Advantages of a shared cache: • Space is dynamically allocated among cores • No waste of space because of replication • Potentially faster cache coherence (and easier to locate data on a miss) • Advantages of a private cache: • small L2  faster access time • private bus to L2  less contention

  12. UCA and NUCA • The small-sized caches so far have all been uniform cache access: the latency for any access is a constant, no matter where data is found • For a large multi-megabyte cache, it is expensive to limit access time by the worst case delay: hence, non-uniform cache architecture

  13. Large NUCA Issues to be addressed for Non-Uniform Cache Access: • Mapping • Migration • Search • Replication CPU

  14. Shared NUCA Cache A single tile composed of a core, L1 caches, and a bank (slice) of the shared L2 cache Core 0 Core 1 Core 2 Core 3 L1 D$ L1 I$ L1 D$ L1 I$ L1 D$ L1 I$ L1 D$ L1 I$ L2 $ L2 $ L2 $ L2 $ Core 4 Core 5 Core 6 Core 7 The cache controller forwards address requests to the appropriate L2 bank and handles coherence operations L1 D$ L1 I$ L1 D$ L1 I$ L1 D$ L1 I$ L1 D$ L1 I$ L2 $ L2 $ L2 $ L2 $ Memory Controller for off-chip access

  15. Virtual Memory • Processes deal with virtual memory – they have the illusion that a very large address space is available to them • There is only a limited amount of physical memory that is shared by all processes – a process places part of its virtual memory in this physical memory and the rest is stored on disk • Thanks to locality, disk access is likely to be uncommon • The hardware ensures that one process cannot access the memory of a different process

  16. Address Translation • The virtual and physical memory are broken up into pages 8KB page size Virtual address 13 virtual page number page offset Translated to phys page number Physical address 13 physical page number page offset Physical memory

  17. Title • Bullet

More Related