Fast Pow – k4i's blog

K4i

light dark hacker solarized kimbie

Posts
Archive
About
Tags
Categories
Series

light dark hacker solarized kimbie

Posts Archive About

k4i's blog
Tags
Fast Pow

Fast Pow

Matrix Fast Pow

📅 Jan 20, 2021 · ☕ 5 min read · 🦂 Kyle

Use matrix and fast pow together can make some problems much easier.

Series LLM Inference Internals 10 LLM Attention Kernels and GPU Primitives 3 VLLM and SGLang Source Reading 3 LLM Quantization and Low-Precision Serving 2 Bandit 1 LLM Inference Lab Reports 1 Segment Tree 1

Categories AI 22 Notes 13 Workspace-Setup 9 Android 3 Data-Structure-and-Algorithm 3 Crypto 2 C 1 Cloud-Computing 1 Ctf 1 Data Structure & Algorithm 1 Debug 1 Proxy 1

Tags Llm 18 Inference 14 Systems 7 Vllm 6 Kv-Cache 4 Sglang 4 Ai-Infra 3 C++ 3 Gpu 3 Gradient-Descent 3 Memory 3 Scheduling 3 Source-Reading 3 Transformer 3 Triton 3 Attention 2 Cheatsheet 2 Crypto 2 Dotfiles 2 Fp8 2 Heap 2 Hugo 2 Int4 2 Kvm 2 Linux 2 Networking 2 Org 2 Performance 2 Qemu 2 Quantization 2 Random 2 Serving 2 Softmax 2 Terminal 2 Tree 2 Windows 2 Activation-Function 1 Adb 1 Agent 1 Backend 1 Batching 1 Benchmark 1 BIT 1 Blog 1 Boot 1 C 1 Caching 1 Clipboard 1 Codex 1 Cuda 1 Curses 1 Cycle-Finding 1 Debugging 1 Decode 1 Deep-Learning 1 Devops 1 Dfs 1 Distributed 1 Distributed-Systems 1 Dp 1 Dsu-on-Tree 1 Editor 1 Embodied-Ai 1 Fast Pow 1 Fenwick 1 Flash-Attention 1 Flops 1 Gcc 1 Github Actions 1 Glibc 1 GnuPG 1 Golang 1 Hypervisor 1 I3 1 Int8 1 Jepa 1 Kernel 1 Kernel-Fusion 1 Kms 1 Knapsack 1 Latency 1 Low-Precision 1 Machine 1 Magisk 1 Math 1 Matrix 1 Mitmproxy 1 Ncurses 1 Neural-Network 1 Online-Softmax 1 Openssl 1 Optimization 1 Pass 1 Password 1 Position-Encoding 1 Prefill 1 Profiling 1 Pwn 1 Ranger 1 RNG 1 Robotics 1 Root 1 Rope 1 RSA 1 Sack 1 Samba 1 Sampling 1 Segment Tree 1 Shell 1 Shortest-Path 1 Shuffle 1 Skills 1 Small-to-Large 1 Smart Pointer 1 Ssh 1 STL 1 Streaming 1 Tampermonkey 1 Tmux 1 Training 1 TUI 1 Twrp 1 Union Find 1 Vim 1 Virtual 1 Vla 1 Wargames 1 Window-Manager 1 Wordpress 1 Workflow 1 World-Model 1

Total visitors ...

Total views ...

All content is subject to the license of CC BY-NC-SA 4.0 .

Powered by Hugo and the Zzo theme