181: Memory Management

Intro topic: Video Game PricesNews/Links:Step one: Jump in the Lava - Abyssofthttps://youtu.be/WdadpHLAfdA?si=oXYnhB0EdkR_RaPEScalable world models for continuous controlhttps://www.tdmpc2.com/Clever code is probably the worst code you could write - Engineer’s Codexhttps://read.engineerscodex.com/p/clever-code-is-probably-the-worstA new, open source text-to-speech model called Dia has arrived to challenge ElevenLabs, OpenAI and morehttps://venturebeat.com/ai/a-new-open-source-text-to-speech-model-called-dia-has-arrived-to-challenge-elevenlabs-openai-and-more/Book of the ShowPatrickThe Muscle Ladder - Jeff Nippardhttps://amzn.to/44DznszJasonMetaphysics of Warhttps://amzn.to/4jMjvZ5Patreon Plug https://www.patreon.com/programmingthrowdown?ty=hTool of the ShowPatrickPokemon Trading Card Game PocketJasonPhi-4https://huggingface.co/spaces/microsoft/phi-4-multimodalTopic: Memory ManagementMotivationAvoid thrashing / crashesAllocate resources efficientlyKeep high uptimeWhereOS LevelHeap managementVirtual MemoryLanguage/Compiler LevelCppGarbage collectionOwnershipToolsInstrumentationExport to Datadog / GrafanaPython: psutil & tracemallocValgrindWhat to do when your program uses too much memory?Reduce data sizesCompressionReferencesLazy initializerGenerators & Back PressureRing buffersArena allocatorsDisk based caching

★ Support this podcast on Patreon ★
]]

Programming Throwdown

Patrick Wheeler and Jason Gauci

180: Reinforcement Learning

182: AI Assisted Coding

Download Audio File

**Intro topic: Video Game Prices

**News/Links:

• Step one: Jump in the Lava - Abyssoft

• https://youtu.be/WdadpHLAfdA?si=oXYnhB0EdkR_RaPE

• Scalable world models for continuous control

• https://www.tdmpc2.com/

• Clever code is probably the worst code you could write - Engineer’s Codex

• https://read.engineerscodex.com/p/clever-code-is-probably-the-worst

• A new, open source text-to-speech model called Dia has arrived to challenge ElevenLabs, OpenAI and more

• https://venturebeat.com/ai/a-new-open-source-text-to-speech-model-called-dia-has-arrived-to-challenge-elevenlabs-openai-and-more/

Book of the Show

• Patrick

• The Muscle Ladder - Jeff Nippard

• https://amzn.to/44Dznsz

• Jason

• Metaphysics of War

• https://amzn.to/4jMjvZ5

Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h

Tool of the Show

• Patrick

• Pokemon Trading Card Game Pocket

• Jason

• Phi-4

• https://huggingface.co/spaces/microsoft/phi-4-multimodal

**Topic: Memory Management

• Motivation

• Avoid thrashing / crashes
• Allocate resources efficiently
• Keep high uptime

• Where

• OS Level

• Heap management
• Virtual Memory

• Language/Compiler Level

• Cpp
• Garbage collection
• Ownership

• Tools

• Instrumentation

• Export to Datadog / Grafana

• Python: psutil & tracemalloc
• Valgrind

• What to do when your program uses too much memory?

• Reduce data sizes

• Compression
• References
• Lazy initializer
• Generators & Back Pressure

• Ring buffers
• Arena allocators
• Disk based caching

Original source