Skip to content
Projects

xgpxg/aiway has 57 GitHub stars and 13 forks. GitHot measured 0 stars in 24 hours and 0 in 7 days. Last checked 2026-11-16 04:19 UTC. Last push 2026-11-04.

How these counts are measured

Measured star growth

in 24h
0
in 7 days
0
in 15 days
Update delayed
in 1 month
Update delayed

Net star changes over overlapping periods, not daily totals. Missing measurements are left blank. Stars measure attention, not software quality.

About

API + AI 融合网关

Developer Tools

README_en.md

Original

aiway (API and AI Gateway) is a lightweight, high-performance API + AI gateway developed in Rust, dedicated to providing stable, efficient, and scalable request forwarding and management solutions.

Leveraging Rust's memory safety features and zero-cost abstractions, aiway delivers exceptional security and stability while maintaining high performance.

Unlike other gateways, aiway requires no complex configuration or environmental dependencies. Gateway nodes can be dynamically scaled out/in, easily handling millions of concurrent connections.

Platform Support

  • Linux (x86_64 / arm64)
  • macOS (arm64)
  • openEuler (x86_64)
  • UOS Server (x86_64)
  • KylinOS (x86_64)

Protocol Support

  • HTTP(IPv4/IPv6)
  • SSE
  • WebSocket
  • MCP

Documentation

For detailed documentation, please visit: Document

Quick Start

Option 1: Using Pre-built Binaries

# Download and extract
curl -L https://github.com/xgpxg/aiway/releases/latest/download/aiway-linux-amd64-standalone.tar.gz | tar -zxvf - -C .

# Start the service
./aiway

Option 2: Building from Source

# Build Gateway
cargo build --bin gateway

# Build Console
cargo build --bin console

# Build Logg
cargo build --bin logg

# Run
cargo run --bin aiway

Accessing the Services

Startup Parameters

./aiway -h

Usage: aiway [OPTIONS]

Options:
      --console-address <CONSOLE_ADDRESS>      Console listen address [default: 127.0.0.1]
      --console-port <CONSOLE_PORT>            Console listen port [default: 7000]
      --gateway-address <GATEWAY_ADDRESS>      Gateway listen address [default: 127.0.0.1]
      --gateway-port <GATEWAY_PORT>            Gateway listen port [default: 7001]
      --log-server <LOG_SERVER>                Log server address [default: 127.0.0.1:7280]
      --access-address <ACCESS_ADDRESS>        Access listen address [default: 0.0.0.0]
      --access-http-port <ACCESS_HTTP_PORT>    Access http listen port [default: 7080]
      --access-https-port <ACCESS_HTTPS_PORT>  Access https listen port [default: 7443]
  -h, --help                                   Print help
  -V, --version                                Print version

Core Features

  • Dynamic Routing
  • Service Management
  • Plugin System
  • Security Protection
  • API Key Management
  • Log Monitoring
  • Visual Dashboard
  • AI Model Proxy
  • MCP Integration
  • Multi-domain Support

Plugin Ecosystem

Known Plugins

We provide a series of commonly used plugins. Visit aiway-plugins for more information.

Custom Plugins

If you need to develop custom plugins, please refer to the Plugin Development Documentation.

Interface Preview

Dashboard

Performance

Current

  • Via access entry point
wrk https://aiway-test-1.coderbox.cn:7443/api/hello -t 12 -c 100
Running 10s test @ http://aiway-test-1.coderbox.cn:7080/api/hello
  12 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     0.99ms  810.80us  34.97ms   96.17%
    Req/Sec     8.43k     1.23k   16.35k    78.69%
  1012287 requests in 10.10s, 253.90MB read
Requests/sec: 100224.67
Transfer/sec:     25.14MB

Before 2026/05/24

  • Ubuntu 24.04, Intel i7-12700K, 12 Cores, 16 GB RAM
wrk http://127.0.0.1:7001/api/hello -t 12 -c 100

Running 10s test @ http://127.0.0.1:7001/api/hello
  12 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     0.89ms  780.09us  28.66ms   95.87%
    Req/Sec     9.54k     1.12k   18.36k    93.70%
  1144556 requests in 10.10s, 287.07MB read
Requests/sec: 113330.59
Transfer/sec:     28.43MB
  • Ubuntu 22.04, 4 Cores, 8 GB RAM
wrk http://127.0.0.1:7001/hello -t 4 -c 100

Running 10s test @ http://127.0.0.1:7001/hello
  4 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     6.70ms    3.05ms  36.85ms   73.84%
    Req/Sec     7.61k   770.50     9.22k    64.50%
  302860 requests in 10.01s, 75.96MB read
Requests/sec:  30265.20
Transfer/sec:      7.59MB

Before 2026/03/26

  • openEuler 24.03 (LTS-SP3), Intel(R) Xeon(R) 6982P-C, 4 Cores, 8 GB RAM
wrk http://127.0.0.1:7001/hello -t 4 -c 100

Running 10s test @ http://127.0.0.1:7001/hello
  4 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.80ms    1.22ms  13.60ms   70.35%
    Req/Sec     6.62k   380.06     7.43k    62.75%
  263639 requests in 10.01s, 74.67MB read
Requests/sec:  26332.11
Transfer/sec:      7.46MB
  • UOS Server 20, Intel(R) Xeon(R) Platinum, 4 Cores, 8 GB RAM
wrk http://127.0.0.1:7001/hello -t 4 -c 100

Running 10s test @ http://127.0.0.1:7001/hello
  8 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.61ms    2.48ms  84.71ms   93.78%
    Req/Sec     3.47k   452.12    11.40k    83.88%
  276965 requests in 10.06s, 78.45MB read
Requests/sec:  27518.91
Transfer/sec:      7.79MB

Contributing

Welcome to submit Issues and Pull Requests to help improve aiway!