# llm-memory

**Repository Path**: debonet/llm-memory

## Basic Information

- **Project Name**: llm-memory
- **Description**: memory estimate for LLM
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2024-10-17
- **Last Updated**: 2025-02-20

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

## development

### estimate

- example

```shell
python memory_estimate/main.py --num-layers 2 --hidden-size 1024 --ffn-hidden-size 3200 --num-attention-heads 32 --vocab-size 59008 --seq-length 2048 --micro-batch-size 3 --group-query-attention --num-query-groups 4 --nproc 2
```

### server

- install dependents

```shell
pip install "fastapi[standard]"
export PYTHONPATH=memory_estimate:$PYTHONPATH
```

- start

```shell
fastapi dev server/main.py
```

### web

```shell
cd web
yarn dev
```