# Qwen3 30B A3B Instruct 2507 FP8

**Qwen3-30B-A3B-Instruct-2507-FP8** is an instruction-tuned 30B-parameter FP8 causal language model for long-context (256K) text generation and reasoning, supporting chat/QA, summarization, multilingual tasks, math/science problem solving, coding, and tool-augmented workflows.

 Category | Details |
|----------|----------|
| **Model Name** | Qwen/Qwen3-30B-A3B-Instruct-2507-FP8 |
| **Version** | 32B - FP8 |
| **Model Category** | LLM |
| **Size** | 30B |
| **HuggingFace Model** | [Qwen/Qwen3-30B-A3B-Instruct-2507-FP8](https://huggingface.co/Qwen/Qwen3-30B-A3B-Instruct-2507-FP8) |
| **OpenAI Compatible Endpoint** | [Chat API Overview](https://developers.openai.com/api/reference/overview) |
| **LICENSE** | [Apache 2.0](https://huggingface.co/datasets/choosealicense/licenses/resolve/main/markdown/apache-2.0.md) |

## Capabilities

| Feature | Status |
|---------|--------|
| Tool Calling | ✅|
| Context Length | 64k |
| Supports LoRA | ✅ |
| Input data | TEXT |

## Usage

### Basic Chat Completion
```ts
const modelResponse = await Azion.AI.run("Qwen/Qwen3-30B-A3B-Instruct-2507-FP8", {
  "stream": true,
  "messages": [
    {
      "role": "system",
      "content": "You are a helpful assistant."
    },
    {
      "role": "user",
      "content": "Name the european capitals"
    }
  ]
})
```

### Tool Calling Example
```ts
const modelResponse = await Azion.AI.run("Qwen/Qwen3-30B-A3B-Instruct-2507-FP8", {
  "stream": true,
  "messages": [
    {
      "role": "system",
      "content": "You are a helpful assistant with access to tools."
    },
    {
      "role": "user",
      "content": "What is the weather in London?"
    }
  ],
  "tools": [
    {
      "type": "function",
      "function": {
        "name": "get_weather",
        "description": "Get the current weather for a location",
        "parameters": {
          "type": "object",
          "properties": {
            "location": {
              "type": "string",
              "description": "The city and state"
            }
          },
          "required": [
            "location"
          ]
        }
      }
    }
  ]
})
```

## JSON Schema
```json
{
    "$schema": "http://json-schema.org/draft-07/schema#",
    "type": "object",
    "required": ["messages"],
    "properties": {
        "messages": {"type": "array", "items": {"$ref": "#/components/schemas/Message"}},
        "temperature": {"type": "number", "minimum": 0, "maximum": 2},
        "top_p": {"type": "number", "minimum": 0, "maximum": 1, "default": 1},
        "n": {"type": "integer", "minimum": 1, "default": 1},
        "stream": {"type": "boolean", "default": false},
        "max_tokens": {"type": "integer", "minimum": 1},
        "presence_penalty": {"type": "number", "minimum": -2, "maximum": 2, "default": 0},
        "frequency_penalty": {"type": "number", "minimum": -2, "maximum": 2, "default": 0},
        "tools": {"type": "array", "items": {"$ref": "#/components/schemas/ToolDefinition"}}
    },
    "components": {
        "schemas": {
            "Message": {"oneOf": [{"$ref": "#/components/schemas/SystemMessage"},{"$ref": "#/components/schemas/UserMessage"},{"$ref": "#/components/schemas/AssistantMessage"},{"$ref": "#/components/schemas/ToolMessage"}]},
            "SystemMessage": {"type": "object", "required": ["role","content"], "properties": {"role": {"type": "string", "enum": ["system"]}, "content": {"$ref": "#/components/schemas/TextContent"}}},
            "UserMessage": {"type": "object", "required": ["role","content"], "properties": {"role": {"type": "string", "enum": ["user"]}, "content": {"$ref":"#/components/schemas/TextContent"}}},
            "AssistantMessage": {"oneOf": [{"$ref": "#/components/schemas/AssistantMessageWithoutToolCalls"},{"$ref": "#/components/schemas/AssistantMessageWithToolCalls"}]},
            "ToolMessage": {"type": "object", "required": ["role","content","tool_call_id"], "properties": {"role": {"enum": ["tool"]}, "content": {"$ref":"#/components/schemas/TextContent"}, "tool_call_id": {"type": "string"}}},
            "AssistantMessageWithoutToolCalls": {"type": "object", "required": ["role","content"], "properties": {"role": {"type": "string", "enum": ["assistant"]}, "content": {"$ref": "#/components/schemas/TextContent"}}, "not": {"required": ["tool_calls"]}},
            "AssistantMessageWithToolCalls": {"type": "object", "required": ["role","tool_calls"], "properties": {"role": {"type": "string", "enum": ["assistant"]}, "tool_calls": {"type": "array", "items": {"$ref": "#/components/schemas/ToolCalls"}}}},
            "TextContent": {"oneOf": [{"type": "string"},{"type": "array", "items": {"$ref": "#/components/schemas/TextContentItem"}}], "description": "Text content that can be provided either as a simple string or as an array of TextContentItem objects"},
            "TextContentItem": {"type": "object", "required": ["type","text"], "properties": {"type": {"type": "string", "enum": ["text"]}, "text": {"type": "string"}}},
            "ToolCalls": {"type": "object", "required": ["function","id","type"], "properties": {"function": {"type": "object", "required": ["name","arguments"], "properties": {"name": {"type": "string"}, "arguments": {"type": "string"}}}, "id": {"type": "string"}, "type": {"enum": ["function"]}}, "description":"The name and arguments of a function that should be called, as generated by the model."},
            "ToolDefinition": {"type": "object", "required": ["type","function"], "properties": {"type": {"type": "string", "enum": ["function"]}, "function": {"type": "object", "required": ["name"], "properties": {"name": {"type": "string"}, "description": {"type": "string"}, "parameters": {"type": "object", "additionalProperties": true}, "strict": {"type": "boolean", "default": false}}}}, "description": "Definition of a tool that can be used by the model"}
        }
    }
}
```