Skip to content

TheCuriousWolf/open-computer-use

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

51 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Open Source Computer Use

A secure cloud Linux computer powered by E2B Desktop Sandbox and controlled by open-source LLMs.

Desktop.Use.+.Streaming.mp4

Features

  • Uses Llama 3.2, 3.3 and OS-Atlas
  • Operates the computer via a combination of keyboard, mouse, and shell commands
  • Live streams the display of the sandbox on the client computer
  • The user can pause the agent and provide feedback and any time
  • Designed to work on any operating system or platform
  • Supports multiple inference providers, including Hugging Face, Fireworks, OpenRouter and Llama AI

Design

Open Source Computer Use Architecture

The details of the design are laid out in this article: How I taught an AI to use a computer

Get started

Prerequisites

1. Install the prerequisites

In your terminal:

brew install poetry ffmpeg

2. Clone the repository

In your terminal:

git clone https://github.com/e2b-dev/open-computer-use/

3. Set the environment variables

Enter the project directory:

cd open-computer-use

Create a .env file in open-computer-use and set the following:

# Get your API key here - https://e2b.dev/
E2B_API_KEY="your-e2b-api-key"
LLAMA_API_KEY="your-llama-api-key"

or

# Get your API key here - https://e2b.dev/
E2B_API_KEY="your-e2b-api-key"
OPENROUTER_API_KEY="your-openrouter-api-key"
FIREWORKS_API_KEY="your-fireworks-api-key"

4. Start the web interface

Run the following command to start the agent:

poetry install
poetry run start

The agent will start and prompt you for its first instruction.

About

Secure AI computer use powered by E2B Desktop Sandbox

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 97.9%
  • HTML 2.1%