Skip to content
ML Systems Notes
03_pvm.py
Initializing search
JINO-ROHIT/ml-systems-notes
ML Systems Notes
Compute
Cuda graphs
Distributed techniques
Jax scaling book
Quantization
Sglang
Torch notes
ML Systems Notes
JINO-ROHIT/ml-systems-notes
ML Systems Notes
Compute
Compute
hand rolling flops for an llm
Cuda graphs
Cuda graphs
01_basic_graph.py
02_overhead_compare.py
03_batch_padding.py
Distributed techniques
Distributed techniques
Collective operations
Collective operations
all_gather.py
all_reduce.py
gather.py
reduce.py
reduce_scatter.py
scatter.py
Moe
Moe
Parallelism strategies
Parallelism strategies
Torch dist
Torch dist
Jax scaling book
Jax scaling book
01 roofline
Quantization
Quantization
Notes
Sglang
Sglang
Kv cache
Kv cache
radix_cache.py
req_to_pool.py
Torch notes
Torch notes
Aotautograd
Aotautograd
01.py
02_make_fx.py
03_joint_graphs.py
Autograd
Autograd
01_backward.py
02_autograd.py
03_second_order.py
04_higher_order.py
05_vector_diff.py
Dynamo
Dynamo
01.py
02_bytecode.py
03_pvm.py
04_guards.py
05_graph_break.py
06_static_dynamic_shape.py
07_explain.py
Fx graphs
Fx graphs
01.py
02_manipulation.py
03_subgraph_rewrite.py
04_dynamic_control_flow.py
05_custom_tracer.py
Inductor
Inductor
Torch.compile
Torch.compile
01_basic.py
02_nested.py
03_speedup.py
04_graph_break.py
03_pvm.py
¶
```python import dis
def foo(a, b): return a + b
dis.dis(foo)```
Back to top