💀 Qwen-Servitor

Decapitated 0.8B Hybrid Gated DeltaNet Decision Gate & OASIS SARIF v2.1.0 Arbiter

---

Overview

Qwen-Servitor is a headless neural decision engine designed for automated pull request review, pre-commit gating, and static code security triage. It operates as the fast, lightweight component in the Servitor family, complementing the larger wxsys/spark-servitor (1.7B, Sliding Window Attention, 1M context).

Where Spark-Servitor provides deep multi-file receptive capacity for massive monorepos, Qwen-Servitor is optimized for speed and minimal memory footprint. Built upon the hybrid backbone of Qwen3.5-0.8B (18 Gated DeltaNet layers and 6 Full Attention layers), the 155M-parameter generative projection layer (lm_head) is excised. Hidden states route directly into a multi-task neural judgment cortex that outputs structured verdicts, calibrated risk scores, pathology tags, and exploit flows in a single forward evaluation pass.

---

Technical Architecture

                       [ RAW DIFF / 262K TOKEN CONTEXT ]
                                      │
                                      ▼
       ┌─────────────────────────────────────────────────────────────┐
       │               QWEN 3.5 HYBRID NEURAL SPINE                  │
       │   • 18x Gated DeltaNet Layers (O(1) Recurrent State)        │
       │   • 6x Gated Full Attention Layers (Global Context)         │
       │   • HySparse2 Cross-Layer KV Sharing (33% GEMM Reduction)   │
       │   • AST-Landmark Eviction (Caps attention cache at 4k tokens│
       │   • 155M-parameter Generative Head: EXCISED / REMOVED       │
       └─────────────────────────────────────────────────────────────┘
                                      │
                         [ Final Hidden State (h_T) ]
                                      │
                                      ▼
       ┌─────────────────────────────────────────────────────────────┐
       │          LATENT RECURRENT PONDERING (k = 1..4)              │
       │   • Internal recurrence loop without token emission         │
       │   • Early halting at confidence threshold p_halt >= 0.95    │
       └─────────────────────────────────────────────────────────────┘
                                      │
             ┌────────────────────────┼────────────────────────┐
             ▼                        ▼                        ▼
     ┌───────────────┐        ┌───────────────┐        ┌───────────────┐
     │ VERDICT HEAD  │        │   RISK HEAD   │        │ PATHOLOGY HEAD│
     │ 3-Way Output  │        │  Sigmoid(1)   │        │ 8-Class Multi │
     │ • APPROVE     │        │  Continuous   │        │ • SECURITY    │
     │ • QUARANTINE  │        │  Risk Score   │        │ • DEADLOCK    │
     │ • REJECT      │        │  (0.00-1.00)  │        │ • PERF_COLLAP │
     └───────┬───────┘        └───────────────┘        └───────────────┘
             │
             ▼ (If QUARANTINE: Formal Neuro-Symbolic Hand-Off)
     ┌───────────────┐
     │ Z3 SMT Solver │ ──> [ Final Verified Gate ]
     └───────────────┘

---

Specifications

Parameter	Specification
Base Architecture	Decapitated Qwen/Qwen3.5-0.8B-Base
Hidden Dimension ($d_{\text{model}}$)	1024
Attention Layers	24 total (18 Gated DeltaNet Linear Layers + 6 Full Attention Layers)
Linear Attention Mechanism	Gated DeltaNet with associative state recurrence ($O(1)$ inference memory)
Full Attention Layers	Interleaved at 4-layer intervals with HySparse2 Cross-Layer KV Sharing
Context Window	Up to 262,144 tokens (AST-Landmark Eviction caps attention cache at 4,096 tokens)
Decision Mechanism	Hierarchical Multi-Task Cortex with Latent Recurrent Pondering ($k = 1..4$)
Execution Latency	11.52 ms median on standard CPU (AVX2 / C++ binary)
Active Memory	~450 MB RAM (AWQ INT4) / ~500 MB (W8A8)

---

Capabilities & Enhancements (v2.5)

1. Single-Pass 3-Way Verdict Gate

Diffs route directly into three deterministic states:

• APPROVE: Patch contains verified changes with no detected pathology (risk $\le 0.20$).
• QUARANTINE: Borderline invariant changes, formal boundary shifts, or ambiguous concurrency locks routed to SMT verification.
• REJECT: Confirmed vulnerability or regression (risk $\ge 0.80$).

2. Parameter-Aware Anti-False-Alarm Taint Tracking

Inspects abstract syntax trees to distinguish between unsafe string concatenation and safe parameterized query execution. Prepared statements, argument tuples (?, %s, $1), and sanitized call wrappers are recognized as valid sanitizers across Python, Go, and TypeScript, eliminating false alarms on database calls.

3. Scope-Aware Indentation Normalization

Diff hunks often contain partial indentations or dangling block clauses (except:, finally:, case, unclosed function blocks). The canonicalizer normalizes relative indentation and wraps unclosed control clauses prior to AST parsing, preventing syntax parser failures on partial diff hunks.

4. Dynamic Auto-Remediation with Closed Self-Verifying Loop

When a defect is identified, the remediation engine synthesizes targeted, git-applicable patch diffs (parameterized queries, argument lists, deferred mutex releases). Each proposed patch undergoes verification through the evaluation engine; only patches that achieve APPROVE with risk $\le 0.35$ are accepted.

5. Outlier-Preserved INT8 Embedding Table Compaction

Quantizes the large token embedding table ($248,320 \times 1024$) using symmetric per-token INT8 scales while preserving top norm outliers in floating-point precision. This cuts embedding storage footprint by ~49.6% while maintaining directional cosine similarity $\ge 0.999$ and 0% vocabulary loss.

6. OASIS SARIF v2.1.0 Exploit Flow Reconstruction

For any detected vulnerability, Qwen-Servitor reconstructs the exploit data-flow path:

[1. SOURCE: Untrusted Input] ──> [2. PROPAGATION: Variable Flow] ──> [3. SANITIZER: Status] ──> [4. SINK: Vulnerable Call]

Emits standard SARIF codeFlows and threadFlows compatible with GitHub Advanced Security and VS Code SARIF Viewer.

---

Available Model Formats

Format	Path in Repository	Size on Disk	Active RAM	Runtime Environment
AWQ INT4 Native	int4/qwen-servitor-awq_int4.servitor	422.7 MB	~450 MB	Standalone C++/Rust binary (11.52 ms latency)
W8A8 Native	int4/qwen-servitor-w8a8.servitor	751.5 MB	~500 MB	High-precision native C-ABI execution
GGUF Q8_0	gguf/qwen-servitor-q8_0.gguf	774.0 MB	~850 MB	llama.cpp / Local CPU inference
GGUF BF16	gguf/qwen-servitor-bf16.gguf	1.45 GB	~1.6 GB	Full precision GGUF runner
Native BF16	bf16/model.safetensors	1.45 GB	~1.6 GB	PyTorch GPU / Server pipelines
Cortex Head	cortex_head.pt	74.0 MB	~100 MB	Decapitated CAMQP multi-task head

---

Benchmark Scorecard

Evaluated across the test suite on standard CPU (AVX2 / FMA instruction set, DDR3-1600 memory):

Benchmark	Value	Target	Status
Median Native Inference Latency	11.52 ms	< 15.0 ms	Met
Throughput (Single Core)	72.7 ops/sec	> 50 ops/sec	Met
Unit & Integration Test Suite	181 / 181 Passed	100%	Met
Prepared Statement False Alarms	0 / 100	0%	Met
Diff Hunk Indentation Parse Errors	0 / 100	0%	Met
Embedding Compaction Cosine Sim	0.9997	$\ge 0.9900$	Met

---

Quickstart

Python API

from qwen_servitor import Servitor

# Initialize engine (loads weights from local path or Hugging Face Hub)
servitor = Servitor.summon("wxsys/qwen-servitor")

git_patch = """
--- a/auth/session.py
+++ b/auth/session.py
@@ -12,4 +12,3 @@ def verify_token(token: str) -> bool:
-    if not validate_hmac(token):
-        raise SecurityException("Invalid HMAC signature")
+    return True  # TODO: temporary debug bypass
"""

verdict = servitor.judge(git_patch)

print(f"Status: {verdict.status}")        # "REJECTED"
print(f"Risk: {verdict.risk:.4f}")         # 0.9984
print(f"Pathologies: {verdict.pathology}") # ["SECURITY_VULN"]
print(f"Latency: {verdict.latency_ms:.2f} ms")

Dynamic Auto-Remediation

from qwen_servitor.remediation import AutoRemediator

remediator = AutoRemediator(servitor=servitor)
remediations = remediator.remediate(git_patch, sarif_filepath="auth/session.py")

for candidate in remediations:
    print(f"Strategy: {candidate.strategy}")
    print(f"Verified Clean: {candidate.verified}")
    print(f"Verified Risk: {candidate.verification_verdict.risk:.4f}")
    print("Synthesized Patch:")
    print(candidate.patch_diff)

CLI and Pre-Commit Hook

# Install git pre-commit hook targeting sub-15ms execution
servitor hook install --strict --veto-threshold 0.80

# Evaluate a specific unified diff and emit SARIF v2.1.0
servitor judge patch.diff --format sarif > report.sarif

---

Related Repositories

• wxsys/spark-servitor: Scaled 1.7B variant with Sliding Window Attention (SWA 512) and 1M token context for deep monorepo analysis.

---

License

• Base model weights are adapted from Alibaba Cloud's Qwen3.5 series under the Apache 2.0 License.
• Servitor architecture, neural cortex, and native runtime are licensed under the Apache 2.0 License.