You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: providers/lmstudio.mdx
+60-6Lines changed: 60 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -63,14 +63,52 @@ LM Studio downloads and runs AI models locally using your computer's resources.
63
63
## Setup Instructions
64
64
65
65
<Steps>
66
-
<Steptitle="Download LM Studio">Visit [LM Studio website](https://lmstudio.ai/) and download the application</Step>
67
-
<Steptitle="Install and Launch">Install LM Studio and launch the application</Step>
68
-
<Steptitle="Download Models">Browse the model library and download models you want to use</Step>
69
-
<Steptitle="Start Local Server">Click "Start Server" in LM Studio to begin the local API server</Step>
70
-
<Steptitle="Configure in Codinit">Set the server URL (usually http://localhost:1234) in Codinit settings</Step>
71
-
<Steptitle="Test Connection">Verify the connection and start using local AI models</Step>
66
+
<Steptitle="Download LM Studio">
67
+
Visit [lmstudio.ai](https://lmstudio.ai) and download the application for your operating system.
68
+
69
+

70
+
</Step>
71
+
<Steptitle="Install and Launch">
72
+
Install LM Studio and launch the application. You'll see four tabs on the left:
73
+
- **Chat**: Interactive chat interface
74
+
- **Developer**: Where you will start the server
75
+
- **My Models**: Your downloaded models storage
76
+
- **Discover**: Browse and add new models
77
+
</Step>
78
+
<Steptitle="Download a Model">
79
+
Navigate to the "Discover" tab, browse available models, and download your preferred model. Wait for the download to complete.
80
+
81
+
**Recommended**: Use **Qwen3 Coder 30B A3B Instruct** for the best experience with CodinIT. This model delivers strong coding performance and reliable tool use.
82
+
</Step>
83
+
<Steptitle="Start the Server">
84
+
Navigate to the "Developer" tab and toggle the server switch to "Running". The server will run at `http://localhost:51732`.
85
+
86
+

87
+
</Step>
88
+
<Steptitle="Configure Model Settings">
89
+
After loading your model in the Developer tab, configure these critical settings:
90
+
- **Context Length**: Set to 262,144 (the model's maximum)
91
+
- **KV Cache Quantization**: Leave unchecked (critical for consistent performance)
92
+
- **Flash Attention**: Enable if available (improves performance)
93
+
</Step>
94
+
<Steptitle="Configure in CodinIT">
95
+
Set the server URL in CodinIT settings and verify the connection to start using local AI models.
96
+
</Step>
72
97
</Steps>
73
98
99
+
### Quantization Guide
100
+
101
+
Choose quantization based on your available RAM:
102
+
103
+
-**32GB RAM**: Use 4-bit quantization (~17GB download)
104
+
-**64GB RAM**: Use 8-bit quantization (~32GB download) for better quality
105
+
-**128GB+ RAM**: Consider full precision or larger models
106
+
107
+
### Model Format
108
+
109
+
-**Mac (Apple Silicon)**: Use MLX format for optimized performance
110
+
-**Windows/Linux**: Use GGUF format
111
+
74
112
## Key Features
75
113
76
114
<BadgeGroup>
@@ -209,3 +247,19 @@ LM Studio downloads and runs AI models locally using your computer's resources.
209
247
<Callouttype="warning">
210
248
**Resource Intensive**: Large models require significant RAM and may run slowly on lower-end hardware.
211
249
</Callout>
250
+
251
+
## Troubleshooting
252
+
253
+
If CodinIT can't connect to LM Studio:
254
+
255
+
1. Verify LM Studio server is running (check Developer tab)
256
+
2. Ensure a model is loaded
257
+
3. Check your system meets hardware requirements
258
+
4. Confirm the server URL matches in CodinIT settings
259
+
260
+
## Important Notes
261
+
262
+
- Start LM Studio before using with CodinIT
263
+
- Keep LM Studio running in background
264
+
- First model download may take several minutes depending on size
0 commit comments