Go-based Telemetry Toolkit
Find a file
saji 68347e8b95
Some checks failed
Go / build (1.21) (push) Failing after 1m6s
Go / build (1.22) (push) Failing after 1m6s
rework DB getters
abandon generic query frag for common structures
Instead of using the QueryFrag struct, which was too generic to be
generally useful, we have moved to a BusEventFilter type, which
contains things we may filter on when we're searching for bus events.
At the moment it just contains names, and start/stop times.
Then in each function we can accept this filter struct and convert
it to fit the query.

We also support general modifiers, and currently have one implemented:
the LimitOffsetModifier. This adds a LIMIT and OFFSET clause to any
statement. these are all applied at the end and receive a stringbuilder
which may prevent certain operations from being structured.
We need to work on this one more, potentially abandoning.
2024-03-01 16:25:33 -06:00
.github/workflows support 1.21, add matrix for 1.21 and 1.22 in CI 2024-02-28 14:17:47 -06:00
cmd clean up dead code 2024-02-28 14:01:44 -06:00
internal rework DB getters 2024-03-01 16:25:33 -06:00
py move parsers to internal library 2024-02-12 14:38:01 -06:00
skylab skylab: add unmarshal bounds check 2024-02-28 18:41:01 -06:00
socketcan fix tests, add packets stuff for db 2024-02-28 01:07:36 -06:00
xbee buncha fixes 2024-02-18 22:41:22 -06:00
.gitignore fix db test compile issue 2023-07-03 13:56:42 -05:00
broker.go buncha fixes 2024-02-18 22:41:22 -06:00
go.mod support 1.21, add matrix for 1.21 and 1.22 in CI 2024-02-28 14:17:47 -06:00
go.sum fix up static check issues 2024-02-28 14:10:40 -06:00
http.go [skip ci] return errors in http api 2024-02-29 13:13:25 -06:00
readme.md Update readme.md 2024-02-26 05:32:20 +00:00

GoTelem: Golang-based telemetry tools

GoTelem is a toolkit and library to make working with solar car telemetry data fast, reliable, and insightful.

Features:

  • SocketCAN interface for connecting to physical hardware.
  • TCP streaming system based around MessagePack-RPC for LAN control/inspection.
  • XBee integration and control for long-range communication.
  • HTTP API for easy external tool integration.
  • SQLite database format for storing telemetry, and tools to work with it.

GoTelem provides a flexible system for ingesting, storing, analyzing, and distributing telemetry information.

Rationale

There are probably two questions:

  1. What's this for?
  2. Why is it written in Go?

Telemetry is an interesting system since it not only involves a microcontroller on the car acting as a transmitter, it also requires software running on a laptop that can recieve the data and do useful things with it. Previous iterations of this PC software usually involved Python scripts that were thrown together quickly due to time constraints. This has a few problems, namely that performance is usually limited, APIs are not type-safe, and environments are not portable and require setup.

So we aught to invest in better tooling - schemas and programs that make working with the data we collect easier and more consistent, as well as being the standard. This tool/repo aims to package several ideas and utilities into a single, all-in-one binary. While that's a noble goal, design decisions are being made to support long-term evolution of software; we have versioned SQLite databases, that are entirely standalone.

I chose to write this in Go because Go has good concurrency support, good cross-compilation, and relatively good performance, especially when compared to interpreted languages.

C/C++ was eliminated due to being too close to the metal and having bad tooling/cross compilation.

Python was eliminated due to having poor concurrency support and difficult packaging/distribution. It also lacks a good http/networking story, instead relying on WSGI/ASGI packages which make Windows not viable. Futhermore, being dynamically typed leads to issues in asserting robustness of the code.

Rust was elminiated due to being too different from more common programming languages. Likewise for F#, C#, D, Zig, Nim, Julia, Racket, Elixr, and Common Lisp. Yes, I did seriouisly consider each of these. C# was a viable competitor but had issues with the cross-platform story.

Go has some quirks and -isms, like lacking "true" Object-Orientation, but the language is designed around being normal to look at, easy to write, and straightforward to understand.

Go has really good cross compilation support built in to the go binary. However, since this package uses some C libraries (SQLite), certain functionality will be missing if you don't have a cross-compiler set up. There's a way to make things easier on Linux using zig cc but this is not usually important since the user can pretty easily compile it on their own system, and it's a single executable to share to others with the same OS/architecture.

Building

gotelem was designed to be all-inclusive while being easy to build and have good cross-platform support. Binaries are a single, statically linked file that can be shared to other users of the same OS. Certain features, like socketCAN support, are only enabled on platforms that support them (Linux). This is handled automatically; builds will exclude the socketCAN files and the additional commands and features will not be present in the CLI.