Topic: memory efficiency
-
Lua 5.5 Launches With Global Variable Declarations and GC Upgrades
Lua 5.5 introduces formal support for declaring global variables, aiding in cleaner code, and achieves significant memory savings, with large arrays using about 60% less memory. The garbage collector is upgraded with a new generational mode and incremental major cycles, reducing performance pause...
Read More » -
Tensormesh Secures $4.5M to Boost AI Inference Performance
Tensormesh has secured $4.5 million in seed funding to commercialize its LMCache tool, which reduces AI inference costs by up to 90% and has attracted interest from major companies like Google and Nvidia. The company's innovation centers on preserving the key-value cache (KV cache) between querie...
Read More » -
Small Language Models: AI21's Edge AI Breakthrough
AI21's Jamba Reasoning 3B is an open-source, 3-billion-parameter model designed for high performance on consumer hardware, featuring a large 250,000-token context window for processing extensive documents and complex tasks efficiently. The model employs a hybrid architecture that blends transform...
Read More » -
Microsoft Releases Bill Gates' 1978 6502 BASIC as Open Source
Microsoft has released the full source code for its 1978 Microsoft BASIC for 6502 Version 1.1 under an open-source MIT license, making it available for use, modification, and distribution. This foundational software, originally developed by Bill Gates and Rick Weiland, powered iconic early person...
Read More »