Hackaday

TurboQuant: Reducing LLM Memory Usage With Vector Quantization

Large language models (LLMs) aren’t actually giant computer brains. Instead, they are massive vector spaces in which the ...
eLife

REM sleep prefrontal high-frequency oscillation chains mediate distinct cortical – hippocampal reactivation patterns compared to NREM sleep

REM (rapid eye movement) and non-REM (NREM) sleep stages contribute to systems memory consolidation in hippocampal-cortical circuits. However, the physiological mechanisms underlying REM memory ...
IEEE

Framework for In-Memory Computing Based on Memristor and Memcapacitor for On-Chip Training

Abstract: Memristive crossbar arrays have gained considerable attention from researchers to perform analog in-memory vector-matrix multiplications in machine learning accelerators with low power and ...
IEEE

Balancing Computation and Communication in Distributed Sparse Matrix-Vector Multiplication

Abstract: Sparse Matrix-Vector Multiplication (SpMV) is a fundamental operation in a number of scientific and engineering problems. When the sparse matrices processed are large enough, distributed ...