Last active
March 29, 2024 08:17
-
-
Save itproto/f9a1931926a4fa32d44797ebaab9d5d2 to your computer and use it in GitHub Desktop.
LAMA
TRY_IT:
https://huggingface.co/chat/conversation/ (SWITCH CODE)
https://github.com/ErikBjare/are-copilots-local-yet https://github.com/TabbyML/tabby
https://github.com/wsxiaoys/awesome-ai-coding https://vaulted-polonium-23c.notion.site/Developer-Tools-f8e4b26d4fe2423bbbe4fb0f41b9f4d0
https://ai.meta.com/blog/code-llama-large-language-model-coding/
- CODE - means + additional specialised training
- Small-b - for autocomplete, 32b for bcode genaration
- Perplexity Chatbot: llama/gemini etc
- google Gemini vertex ai
- AWS CodeWhisperer
- AWS Saghemaker to deploy Lama
- OLLAMA Download available LLM
- cost *$$1.5K AWS https://llama-2.ai/llama-2-aws-environment-cost/
- https://www.philschmid.de/sagemaker-llama-llm
connect LLM with your data (vector databases)
LLM + local vector DB
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Model Name | Developer | Architecture | Number of Parameters | Year Released | |
|---|---|---|---|---|---|
| GPT-3 | OpenAI | Transformer | 175 billion | 2020 | |
| BERT | Bidirectional Transformer | 110 million | 2018 | ||
| T5 | Text-to-Text Transformer | 11 billion | 2019 | ||
| XLNet | Google Brain | Permutation-based Transformer | 340 million | 2019 | |
| RoBERTa | Facebook AI | Bidirectional Transformer | 355 million | 2019 | |
| ALBERT | Google Research & Toyota Technological Institute at Chicago | Bidirectional Transformer | 12 million | 2019 | |
| ELECTRA | Google Research | Transformer | 335 million | 2020 |
Author
itproto
commented
Mar 18, 2024
- great llm summary https://youtu.be/zjkBMFhNj_g?si=3edPjpjcu1UqVNCH
Author
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
