Deep dive into Kernel

This chapter is testing the Llama 2 easily. I am going to deploy web service using FastAPI and Llama 2. Run web server git clone https://github.com/choonho/llama_server.git cd llama_server pip3 install llama-cpp-python langchain pip3 install fastapi uvicorn Prepare Llama 2 model file In step 2, we created Llama 2 model file, copy to "models/7B/ggml-model-q4_0.bin" Run Server python3 server.py Te..

To program Llama 2 easily, it is highly recommended to encode quantized model. There is llama C++ port repository. Download llama.cpp git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp make Convert model to GGLM format cd llama.cpp python3 -m venv llama2 source llama2/bin/activate python3 -m pip install -r requirements.txt Converting process consists of two step. convert model to ..

This post describe how to use Llama 2 in Apple Silicon Macbook. Download model To download Llama 2 model from Meta, https://ai.meta.com/llama/ After fill up the form, you will get email from Meta. The title of email is "Get Started with Llama 2" Clone Git repository To download Llama 2 model, you need to download git repository first. git clone https://github.com/facebookresearch/llama.git In th..

Keras https://blog.naver.com/sundooedu/221315683165 딥러닝(Deep Learning) 구현 라이브러리, 케라스(Keras) 딥러닝(Deep Learning) 라이브러리인 케라스(Keras)는 딥러닝 비전문가라도 각자 분야에서 손쉽게 딥러... blog.naver.com Reinforcement Learning https://blog.naver.com/PostList.nhn?blogId=horajjan&from=postList&categoryNo=81&parentCategoryNo=81 헤헤헤 : 네이버 블로그 The life is only once blog.naver.com 예제 코드 https://github.com/solaris33/deep-learning-t..