Skip to content

Latest commit

 

History

History
36 lines (21 loc) · 968 Bytes

README.md

File metadata and controls

36 lines (21 loc) · 968 Bytes

Phi-3.5 WebGPU

A simple React + Vite application for running Phi-3.5-mini-instruct, a powerful small language model, locally in the browser using Transformers.js and WebGPU-acceleration.

If you dont want install the solution you can run it from a Hugging Face Space

Getting Started

Follow the steps below to set up and run the application running in the codespaces environment.

1. Navigate to the Project Directory

Change your working directory to the phi-3.5-webgpu folder:

cd src/02.phi-3.5-webgpu

3. Install Dependencies

Install the necessary dependencies using npm:

npm i

4. Run the Development Server

Start the development server:

npm run dev

The application should now be running locally. Open your browser and go to http://localhost:5173 to see it in action.