Salient Engineering Logo
Gemma 4 26B A4B | Salient Engineering
Private Models

Gemma 4 26B A4B

Gemma 4 26B, with 4 billion active parameters, on a GPU instance in your AWS account. Text and image input, with no per-token charge.

  • Stays in your AWS account
  • Hourly software fee, unlimited use of that instance
  • Reasoning, coding, and image input
  • Free trial on AWS Marketplace
Available in AWS
Free Trial with AWS

Quick start

Check your GPU quota before you subscribe

GPU instances need the EC2 quota Running On-Demand G and VT instances (code L-DB2E81BA) in your Region. It must be at least the vCPU count of the instance (g6.xlarge has 4 vCPUs). New AWS accounts often start at 0, and the launch then fails. Check or request the quota.

  1. Subscribe on AWS Marketplace. The free trial covers the software fee; EC2 charges still apply.
  2. Launch on g6.xlarge. In the security group, allow TCP 443 from the addresses that will call the API, and TCP 22 only if you need SSH.
  3. Wait about 8 minutes. In the EC2 console, open the instance, then Actions, Monitor and troubleshoot, Get system log. When the model is ready the log shows the endpoint, the API key, and example requests.
    curl -k https://PUBLIC_IP/healthz
  4. Send a request with the API key. The certificate is self-signed, so use -k or pin the fingerprint from the system log.
    curl -k https://PUBLIC_IP/v1/chat/completions \
  -H "Authorization: Bearer API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"gemma4:26b","messages":[{"role":"user","content":"Hello"}]}'

Instance types on this listing: g5.xlarge, g5.2xlarge, g6.xlarge, g6e.xlarge, g6e.2xlarge. The model name in requests is gemma4:26b.