Cache Organization
The tag-index-offset split, direct-mapped versus set-associative lookup, line size and index translation, and the numbers that decide hit rate and hit time.
Replacement and Write Policy
How a set chooses the line to evict and how a write reaches the next level: LRU and its approximations, write-back versus write-through, and the traffic each choice costs.
Misses, Prefetch and Blocking
The three Cs plus coherence, non-blocking caches and MSHRs, hardware and software prefetch, and cache blocking as the software answer to a working set that will not fit.
Multilevel and Inclusion
Private L1 and L2 behind a shared L3: what inclusive, exclusive and non-inclusive caches cost in effective capacity, snoop filtering and back-invalidation traffic.