Passa al contenuto principale

Str umento llama - cre ate

Uso

Cre are un progetto

npx create-llama@latest
✔ Which template would you like to use? › Chat
✔ Which framework would you like to use? › FastAPI (Python)
✔ Would you like to generate a NextJS frontend for your FastAPI (Python) backend? … No

✔ Which model would you like to use? › gpt-3.5-turbo-0125
✔ Which embedding model would you like to use? › text-embedding-3-small

✔ Which data source would you like to use? › Use an example PDF
✔ Would you like to add another data source? › No

✔ Would you like to use LlamaParse (improved parser for RAG - requires API key)? … yes
✔ Please provide your LlamaIndex Cloud API key (leave blank to skip): …

✔ Would you like to use a vector database? › PostgreSQL

Cre are un database in Su pa B ase , ottenere la string di con nes sione M igration

Ri emp ire il file . en v

Pass are all ' ambiente con da

Pass are all ' ag ente

Ag gi orn are la versione della libr eria in py pro ject . tom l

[tool]
[tool.poetry]
name = "app"
version = "0.1.0"
description = ""
authors = [ "Marcus Schiesser <mail@marcusschiesser.de>" ]
readme = "README.md"

[tool.poetry.dependencies]
python = "^3.11,<3.12"
fastapi = "^0.110.1"
python-dotenv = "^1.0.0"
llama-index = "0.10.28"
llama-index-core = "0.10.28"
llama-index-agent-openai = "0.2.2"

[tool.poetry.dependencies.uvicorn]
extras = [ "standard" ]
version = "^0.29.0"

[tool.poetry.dependencies.llama-index-vector-stores-postgres]
version = "^0.1.1"

[tool.poetry.dependencies.llama-index-vector-stores-pinecone]
version = "^0.1.3"

[tool.poetry.dependencies.docx2txt]
version = "^0.8"

[build-system]
requires = [ "poetry-core" ]
build-backend = "poetry.core.masonry.api"

Gest ore di pac ch etti

Uti liz zo di Po et ry , ma Po et ry install utiliz za sempre l ' ambiente virtu ale di Po et ry , che è sog getto a problemi .

L ' installa zione con pip non com met ter à err ori .

pip install .

Gener are un indi ce

python app/engine/generate.py

Err ore con text - emb edding - 3 - large .

  File "/Users/yanghaibin/anaconda3/envs/LI311-b/lib/python3.11/site-packages/pgvector/utils/__init__.py", line 35, in to_db
raise ValueError('expected %d dimensions, not %d' % (dim, len(value)))
sqlalchemy.exc.StatementError: (builtins.ValueError) expected 1536 dimensions, not 3072

Le modi fiche dell ' ambiente non vengono aggi orn ate e occ orre apr ire una nuova finestra della riga di comando .

Dist ribu zione al render

Com pila zione manten endo il valore prede fin ito : po et ry install

Ese cuzione : py thonmain.py

Es em pio di progetto - legg ere : Python - F ast API

Cat alogo di sorg enti

image-20240410092800214

È necessario trasform are media _ type = " text / pla in " in text / event - stream , ma con Post man , ho trovato un problema ~ ~

return Stre aming Res ponse (ev ent _ gener ator (), media _ type =" text/pla in ")