Software Installation Guide

Estimated Time: 1 hour | Difficulty: Easy

PC Software Installation

1. Python Environment Setup

Recommended Version: Python 3.10 (Required)

# Method 1: Using Conda (Recommended)
conda create -n py310 python=3.10
conda activate py310

# Method 2: Using Official Python
# Download Python 3.10 installer from python.org

Python environment configuration interface

2. Dependency Installation

# After receiving the source code via email, extract and navigate to the project
cd delta-robot/pc

# Install dependencies
pip install -r requirements.txt

Main Dependencies in requirements.txt:

• PySide6 - GUI framework

• OpenCV - Image processing

• ultralytics - YOLOv8 object detection

• pyserial - Serial communication

• numpy - Numerical computation

3. YOLOv8 Model Download

# Pre-trained model is included in the source code package
# Place in pc/models/ if not already there
# Model will also auto-download on first run if missing

4. Camera Drivers

Ensure PC camera or USB camera has drivers installed and is recognized by the system.

# Test camera
python -c "import cv2; print('Camera:', cv2.VideoCapture(0).isOpened())"

ESP32 Firmware Upload

1. Arduino IDE Installation

• Download Arduino IDE

• Install and launch Arduino IDE

Arduino IDE configuration interface

2. ESP32 Core Installation

1. Open: File → Preferences
2. Add to "Additional Boards Manager URLs":
   https://raw.githubusercontent.com/espressif/arduino-esp32/gh-pages/package_esp32_index.json
3. Open: Tools → Board → Boards Manager
4. Search "ESP32", install "esp32 by Espressif Systems"

3. Firmware Upload Process

• Open esp32/src/esp32.ino in Arduino IDE (or use PlatformIO)

• Select board: Tools → Board → ESP32 Dev Module

• Select port: Tools → Port → COM3 (adjust as needed)

• Configure settings: Upload Speed: 115200

• Flash Frequency: 80MHz

• Partition Scheme: Default

• Click "Upload" button

4. Serial Test

Open: Tools → Serial Monitor
Baud Rate: 115200
Input: G28
Should see: ok (or motors start moving)

✅ Firmware Upload Successful If serial monitor receives response, firmware is working properly!

First Run

1. Start PC Software

cd E:\DeltaRobot\pc
conda activate py310
python CameraDetect.py

PC software main interface

2. Connect ESP32

• Select correct serial port in GUI (COM3 or COM4)

• Set baud rate: 115200

• Click "Open Port" button

• Status bar shows "Connected"

Serial connection success interface

3. Interface Features

• Video Stream : Real-time camera feed display

• Detection Results : YOLOv8 identified object bounding boxes

• Serial Debug : Send GCode commands

• Coordinate Transform : Click image to get robot coordinates

• Auto Pick : One-click automatic sorting

4. Basic Function Test

• Test video stream: Camera feed should display normally

• Test object detection: Place object, detection box should appear

• Test serial: Send G28, robot arm homes

• Test coordinates: Click on screen, serial sends corresponding coordinates

Common Issues

Q: Serial port connection failed?

Possible Causes:

• USB driver not installed (install CP2102 or CH340 driver)

• Wrong port selected (check Device Manager)

• Port occupied by other program (close Arduino IDE)

Q: Python dependency error?

Solution:

# Upgrade pip
python -m pip install --upgrade pip

# Reinstall dependencies
pip install -r requirements.txt --force-reinstall

Q: GUI won't start?

Check:

• Python version is 3.10

• PySide6 correctly installed

• Run python --version to confirm

Q: Camera not recognized?

Solution:

• Check camera permissions (Windows Settings)

• Change camera ID (in code: cv2.VideoCapture(0) to 1 or 2)

• Test camera: Windows Camera App

Next Step

After software installation, proceed to system calibration:

→ Calibration Process