Cleanup README
Browse files
README.md
CHANGED
|
@@ -8,33 +8,31 @@ This project integrates speech-to-text and text-to-speech functionalities into a
|
|
| 8 |
|
| 9 |
## Features
|
| 10 |
|
| 11 |
-
• Speech-to-Text and Text-to-Speech: Enables the car assistant to listen to spoken questions and respond audibly, providing a hands-free experience for drivers and passengers.
|
| 12 |
-
• Intelligent Function Calling with NexusRaven: Implements a sophisticated system for executing commands and retrieving information based on user queries, using the LLaMA 2 model's capabilities.
|
| 13 |
-
• Dynamic Model Integration: Incorporates multiple models for language recognition, speech processing, and text generation.
|
| 14 |
-
• User-Friendly Gradio Interface: easy-to-use interface for testing and deploying the speaking assistant within the car's infotainment system.
|
| 15 |
• Real-Time Information Retrieval: Capable of integrating with various APIs to provide up-to-date information on weather, routes, points of interest, and more.
|
| 16 |
|
| 17 |
## Requirements
|
| 18 |
|
| 19 |
-
• Gradio for creating interactive interfaces
|
| 20 |
-
• Hugging Face Transformers and additional ML models for speech and language processing
|
| 21 |
-
• NexusRaven for complex function execution
|
| 22 |
All required libraries and packages are directly loaded inside the notebook.
|
| 23 |
|
| 24 |
## Installation
|
| 25 |
|
| 26 |
-
To set up the speaking assistant in your car's system, follow these steps:
|
| 27 |
-
1. Run all the cells until the “Interfaces (text and audio)” section.
|
| 28 |
-
2. Choose between the interfaces which one to run: audio-to-audio or text-to-text.
|
| 29 |
-
Usage
|
| 30 |
-
1. Model Setup: Begin by loading the necessary models for speech recognition, language processing, and text-to-speech conversion as detailed in the "Models loads" section.
|
| 31 |
-
2. Function Definition: Customize the assistant's responses and capabilities by defining functions in the "Function calling with NexusRaven" section.
|
| 32 |
-
3. Interface Configuration: Choose the Gradio interface that suits your in-car system, following setup instructions in the "Interfaces (text and audio)" section.
|
| 33 |
-
4. Activation: Execute one of the interface to start the speaking assistant, enabling vocal interactions within the car.
|
| 34 |
|
| 35 |
## Authors and acknowledgment
|
| 36 |
|
| 37 |
-
Sasan Jafarnejad
|
| 38 |
-
Abigail Berthe--Pardo
|
| 39 |
-
|
| 40 |
-
|
|
|
|
| 8 |
|
| 9 |
## Features
|
| 10 |
|
| 11 |
+
• Speech-to-Text and Text-to-Speech: Enables the car assistant to listen to spoken questions and respond audibly, providing a hands-free experience for drivers and passengers.
|
| 12 |
+
• Intelligent Function Calling with NexusRaven: Implements a sophisticated system for executing commands and retrieving information based on user queries, using the LLaMA 2 model's capabilities.
|
| 13 |
+
• Dynamic Model Integration: Incorporates multiple models for language recognition, speech processing, and text generation.
|
| 14 |
+
• User-Friendly Gradio Interface: easy-to-use interface for testing and deploying the speaking assistant within the car's infotainment system.
|
| 15 |
• Real-Time Information Retrieval: Capable of integrating with various APIs to provide up-to-date information on weather, routes, points of interest, and more.
|
| 16 |
|
| 17 |
## Requirements
|
| 18 |
|
| 19 |
+
• Gradio for creating interactive interfaces
|
| 20 |
+
• Hugging Face Transformers and additional ML models for speech and language processing
|
| 21 |
+
• NexusRaven for complex function execution
|
| 22 |
All required libraries and packages are directly loaded inside the notebook.
|
| 23 |
|
| 24 |
## Installation
|
| 25 |
|
| 26 |
+
To set up the speaking assistant in your car's system, follow these steps:
|
| 27 |
+
1. Run all the cells until the “Interfaces (text and audio)” section.
|
| 28 |
+
2. Choose between the interfaces which one to run: audio-to-audio or text-to-text.
|
| 29 |
+
### Usage
|
| 30 |
+
1. Model Setup: Begin by loading the necessary models for speech recognition, language processing, and text-to-speech conversion as detailed in the "Models loads" section.
|
| 31 |
+
2. Function Definition: Customize the assistant's responses and capabilities by defining functions in the "Function calling with NexusRaven" section.
|
| 32 |
+
3. Interface Configuration: Choose the Gradio interface that suits your in-car system, following setup instructions in the "Interfaces (text and audio)" section.
|
| 33 |
+
4. Activation: Execute one of the interface to start the speaking assistant, enabling vocal interactions within the car.
|
| 34 |
|
| 35 |
## Authors and acknowledgment
|
| 36 |
|
| 37 |
+
Sasan Jafarnejad
|
| 38 |
+
Abigail Berthe--Pardo
|
|
|
|
|
|