Skip to content

Debian package with systemd socket activation (bitnet-server) #557

Description

Built a Debian package that runs BitNet b1.58 2B4T as a systemd service on Ubuntu 24.04.

What it does:

  • sudo apt install bitnet-server from PPA
  • OpenAI-compatible API on localhost:11435
  • Socket activation: 112KB idle, starts on first request
  • Auto-downloads model from HuggingFace
  • Sandboxed (unprivileged user, systemd protections)

PPA: ppa:satyajeet1827/bitnet-server
Source: https://github.com/123Satyajeet123/bitnet-server

Sharing in case it's useful for the community or worth linking from the README. Happy to answer questions about the packaging approach.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions