Updated package v4.7

Author: UtkarshTheDev

CHANGELOG.md

@@ -2,6 +2,18 @@
 
 All notable changes to LocalLab will be documented in this file.
 
+## 0.4.7 - 2025-03-08
+
+### Added
+
+- Enhanced CLI with interactive configuration wizard
+- Added persistent configuration storage
+- Implemented environment detection for smart defaults
+- Added command groups: start, config, info
+- Added support for configuring optimizations through CLI
+- Improved Google Colab integration with context-aware prompts
+- Added system information command
+
 ## 0.4.6 - 2025-03-08
 
 ### Fixed

docs/README.md

@@ -43,6 +43,7 @@ sequenceDiagram
 docs/
 ├── guides/           # Start here for comprehensive guides
 │   ├── getting-started.md  # Begin your journey
+│   ├── cli.md             # Command-line interface guide
 │   ├── api.md             # API documentation
 │   ├── faq.md            # Common questions
 │   ├── troubleshooting.md # Solve common issues
@@ -71,8 +72,9 @@ docs/
 ### For New Users
 
 1. Start with our [Getting Started Guide](./guides/getting-started.md)
-2. Choose your client: [Python](./clients/python/README.md) or [Node.js](./clients/nodejs/README.md)
-3. Pick your deployment: [Local](./deployment/local.md) or [Google Colab](./colab/README.md)
+2. Explore the [CLI Guide](./guides/cli.md) for interactive setup
+3. Choose your client: [Python](./clients/python/README.md) or [Node.js](./clients/nodejs/README.md)
+4. Pick your deployment: [Local](./deployment/local.md) or [Google Colab](./colab/README.md)
 
 ### Deployment Decision Guide
 
@@ -109,6 +111,7 @@ stateDiagram-v2
 1. **New Users**
 
    - Start with [Getting Started](./guides/getting-started.md)
+   - Explore the [CLI Guide](./guides/cli.md) for interactive setup
    - Check [FAQ](./guides/faq.md) for common questions
    - Use [Troubleshooting](./guides/troubleshooting.md) when stuck
 
@@ -132,6 +135,7 @@ stateDiagram-v2
 
 ## 🌟 Features
 
+- **Interactive CLI**: Configure and run your server with an intuitive command-line interface
 - **Multiple Model Support:** Pre-configured models and custom model loading
 - **Advanced Optimizations:** Quantization, attention slicing, and more
 - **Resource Management:** Automatic monitoring and optimization

docs/guides/README.md

@@ -1,16 +1,20 @@
 # LocalLab Guides
 
 ## Getting Started
+
 - [Getting Started Guide](./getting-started.md) - Start here!
+- [CLI Guide](./cli.md) - Interactive command-line interface
 - [API Reference](./api.md)
 - [FAQ](./faq.md)
 - [Troubleshooting](./troubleshooting.md)
 
 ## Advanced Topics
+
 - [Advanced Usage](./advanced.md)
 - [Contributing](./contributing.md)
 
 ## Related Documentation
+
 - [Client Libraries](../clients/README.md)
 - [Deployment Options](../deployment/README.md)
 - [Features](../features/README.md)

docs/guides/advanced.md

@@ -6,12 +6,22 @@
 2. [Performance Optimization](#performance-optimization)
 3. [Model Management](#model-management)
 4. [System Configuration](#system-configuration)
-5. [Best Practices](#best-practices)
+5. [CLI Configuration](#cli-configuration)
+6. [Best Practices](#best-practices)
 
 ## Advanced Features
 
 ### Custom Model Loading
 
+**Using CLI (New!)**
+
+```bash
+# Load a custom model with the CLI
+locallab start --model meta-llama/Llama-2-7b-chat-hf
+```
+
+**Using Environment Variables**
+
 ```python
 import os
 from locallab import start_server
@@ -48,6 +58,15 @@ responses = await client.batch_generate(prompts)
 
 ### 1. Memory Optimization
 
+**Using CLI (New!)**
+
+```bash
+# Enable memory optimizations via CLI
+locallab start --quantize --quantize-type int8 --attention-slicing
+```
+
+**Using Environment Variables**
+
 ```python
 # Enable memory optimizations
 os.environ["LOCALLAB_ENABLE_QUANTIZATION"] = "true"
@@ -57,6 +76,15 @@ os.environ["LOCALLAB_ENABLE_CPU_OFFLOADING"] = "true"
 
 ### 2. Speed Optimization
 
+**Using CLI (New!)**
+
+```bash
+# Enable speed optimizations via CLI
+locallab start --flash-attention --better-transformer
+```
+
+**Using Environment Variables**
+
 ```python
 # Enable speed optimizations
 os.environ["LOCALLAB_ENABLE_FLASH_ATTENTION"] = "true"
@@ -120,14 +148,66 @@ os.environ["LOCALLAB_ENABLE_FILE_LOGGING"] = "true"
 os.environ["LOCALLAB_LOG_FILE"] = "locallab.log"
 ```
 
+## CLI Configuration
+
+The LocalLab CLI provides a powerful way to configure and manage your server. Here are some advanced CLI features:
+
+### Interactive Configuration Wizard
+
+```bash
+# Run the configuration wizard
+locallab config
+```
+
+### System Information
+
+```bash
+# Get detailed system information
+locallab info
+```
+
+### Advanced CLI Options
+
+```bash
+# Start with advanced configuration
+locallab start \
+  --model microsoft/phi-2 \
+  --port 8080 \
+  --quantize \
+  --quantize-type int4 \
+  --attention-slicing \
+  --flash-attention \
+  --better-transformer
+```
+
+### Persistent Configuration
+
+The CLI stores your configuration in `~/.locallab/config.json`. You can edit this file directly for advanced configuration:
+
+```json
+{
+  "model_id": "microsoft/phi-2",
+  "port": 8080,
+  "enable_quantization": true,
+  "quantization_type": "int8",
+  "enable_attention_slicing": true,
+  "enable_flash_attention": true,
+  "enable_better_transformer": true
+}
+```
+
+For more details, see the [CLI Guide](./cli.md).
+
 ## Best Practices
 
 1. **Resource Management**
+
    - Monitor system resources
    - Use appropriate quantization
    - Enable optimizations based on hardware
 
 2. **Error Handling**
+
    ```python
    try:
        response = await client.generate("Hello")
@@ -148,6 +228,7 @@ os.environ["LOCALLAB_LOG_FILE"] = "locallab.log"
 
 ## Related Resources
 
-- [API Reference](https://github.com/Developer-Utkarsh/LocalLab/blob/main/docs/features/api-reference.md)
-- [Configuration Guide](https://github.com/Developer-Utkarsh/LocalLab/blob/main/docs/features/configuration.md)
-- [Troubleshooting](https://github.com/Developer-Utkarsh/LocalLab/blob/main/docs/troubleshooting.md)
+- [CLI Guide](./cli.md)
+- [API Reference](./api.md)
+- [Configuration Guide](../features/configuration.md)
+- [Troubleshooting](./troubleshooting.md)