Jim ChangSoftware Engineer ยท System Integration
Manufacturing

Equipment Monitoring & Auto-Recovery

Self-contained Windows platform that reads machine screens over VNC, turns them into alarms and readings, and clears known faults automatically.

The problem

Many production machines expose their state only through a vendor HMI screen, with no API or data feed. Operators watched the screens and cleared recurring alarms by hand, and any solution had to run unattended for years on an isolated plant network.

What I built

  • A from-scratch VNC (RFB) client in C#: handshake, VNC authentication, and Raw and ZRLE screen encodings.
  • OCR on configured screen regions through supervised PaddleOCR workers, turning matching text into alarms and readings.
  • An RPA engine that replays recorded keyboard-and-mouse scripts to clear known alarms, with leases and crash recovery.
  • React web console with dashboards, alerts and alarm history, live machine views, automation sets and run history, screen-data readings, reports and fleet administration.
  • A native Win32 agent on each machine that blocks local input and shows an on-screen banner while automation or remote control is running.

Technical highlights

  • Re-platformed from a multi-container Linux stack to self-contained .NET 10 Windows services, a better fit for air-gapped plants.
  • PostgreSQL holds the work queue and, through TimescaleDB, the history of screen readings.
  • Signed update packages with journaled apply and rollback, delivered through an offline installer.
  • Designed for 1,500 to 2,000 machines, with around 300 test files including integration tests against a real PostgreSQL.
  • A containerised fleet of simulated HMI machines for testing without plant access.

Need something built or connected?

Send me a few lines on what you need and when you need it by.