Skip to content

Commit 5a4a1a1

Browse files
authored
Add files via upload
1 parent 765e9eb commit 5a4a1a1

2 files changed

+113
-0
lines changed
Lines changed: 56 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,56 @@
1+
# Evaluation Rubric for Portfolio Project
2+
3+
Candidates are to submit a public Github repo of an ML project built mainly on Python. This will be evaluated using the following rubric. Candidates must explain their design choices in a one-to-one 30 min interview after the project has been graded and accepted. We encourage candidates to prepare a brief powerpoint presentation for this (15 slides).
4+
5+
The minimum grade to pass the portfolio project is 70 points.
6+
7+
1. **Data Preparation and Preprocessing (10 points)**:
8+
- How effectively is the data cleaned, normalized, and preprocessed?
9+
- Are techniques like handling missing data, normalization, and feature engineering appropriately applied?
10+
- Is there a thoughtful approach to dealing with imbalanced data or outliers?
11+
12+
2. **Model Selection and Rationale (10 points)**:
13+
- Is the choice of model suitable for the problem at hand?
14+
- How well is the reasoning for selecting a particular model articulated?
15+
- Are comparisons made with alternative models?
16+
17+
3. **Model Training and Validation (10 points)**:
18+
- How effectively is the model trained and validated?
19+
- Are appropriate metrics chosen for evaluating model performance?
20+
- Is there a robust approach to training, such as cross-validation or use of a validation set?
21+
22+
4. **Code Quality and Efficiency (10 points)**:
23+
- Is the code well-organized, readable, and efficient?
24+
- Are best practices in coding and software engineering followed?
25+
- How are error handling and exception management implemented?
26+
27+
5. **API Design and Implementation (10 points)**:
28+
- How well is the REST API designed (endpoints, request-response structure)?
29+
- Are best practices in API development (like security, scalability) considered?
30+
- Is there proper documentation for the API (e.g., Swagger documentation)?
31+
32+
6. **Model Deployment and Environment (10 points)**:
33+
- How effectively is the model deployed for use via the REST endpoint?
34+
- Are considerations like load balancing, scalability, and environment stability addressed?
35+
- Is there an effective use of cloud services or containerization (e.g., Docker)?
36+
37+
7. **Integration of Machine Learning and API (10 points)**:
38+
- How well are the machine learning model and REST API integrated?
39+
- Is there efficient handling of requests and responses between the server and the model?
40+
- Are there measures for performance optimization in the integration?
41+
42+
8. **Security and Data Privacy (10 points)**:
43+
- Are security best practices for APIs and machine learning models implemented?
44+
- How is data privacy and protection handled, especially with sensitive data?
45+
- Are there mechanisms to prevent common vulnerabilities (e.g., SQL injection, data leaks)?
46+
47+
9. **Testing and Reliability (10 points)**:
48+
- How thoroughly is the system (both the model and API) tested?
49+
- Are there unit tests, integration tests, and system tests?
50+
- Is there evidence of reliable and consistent performance under different scenarios?
51+
52+
10. **Documentation, Reporting, and Usability (10 points)**:
53+
- Is the project well-documented, including model training, API usage, and deployment details?
54+
- Are the results, challenges, and decision-making processes clearly communicated?
55+
- Is the API user-friendly and easy to use for the end-users?
56+
Lines changed: 57 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,57 @@
1+
2+
# Evaluation Rubric for Project Interview
3+
4+
**Discussion Point 1: Problem Definition and Motivation (40 points)**
5+
6+
- **Problem Definition (15 points):**
7+
- Clear articulation of the problem statement.
8+
- Identification of stakeholders and target audience.
9+
- Justification of why solving this problem is important or relevant.
10+
11+
- **Motivation (15 points):**
12+
- Explanation of the context or background leading to the problem statement.
13+
- Discussion of potential impact or benefits of solving the problem.
14+
- Demonstration of understanding of the problem's significance in its respective domain.
15+
16+
- **Metrics Alignment (10 points):**
17+
- Selection and justification of appropriate evaluation metrics.
18+
- Explanation of how chosen metrics align with the problem statement and desired outcomes.
19+
- Consideration of potential limitations or biases in chosen metrics.
20+
21+
**Discussion Point 2: Techniques Used and Code Implementation (40 points)**
22+
23+
- **Technique Description (20 points):**
24+
- Comprehensive explanation of the machine learning techniques employed.
25+
- Discussion of why these techniques were chosen over alternatives.
26+
- Description of any modifications or customizations made to suit the problem.
27+
28+
- **Code Implementation (20 points):**
29+
- Clear demonstration of how the techniques were implemented in code.
30+
- Well-organized and documented codebase.
31+
- Consideration of best practices in code structure, readability, and efficiency.
32+
33+
**Discussion Point 3: Presentation Clarity (20 points)**
34+
35+
- **Google Slides (10 points):**
36+
- Effective use of Google Slides as a presentation medium.
37+
- Clarity of visual aids, if any, used in the presentation.
38+
- Consistency and coherence in slide design and layout.
39+
40+
- **Structure and Delivery (10 points):**
41+
- Clear and concise introduction setting the stage for the presentation.
42+
- Well-defined problem statement that captures the audience's attention.
43+
- Coherent conclusions summarizing key findings and insights.
44+
- Insightful discussion of potential avenues for future work or improvement.
45+
46+
#### References:
47+
1. [ML Model Evaluation and Selection](https://neptune.ai/blog/ml-model-evaluation-and-selection)
48+
2. [Best Practices for Code Documentation in Python](https://realpython.com/documenting-python-code/)
49+
3. [Tips for Effective Presentation Design](https://www.youtube.com/watch?v=4TQC83nGv4Y)
50+
4. [How to Enhance your Machine Learning Presentation with Visuals and Stories](https://www.linkedin.com/advice/0/how-do-you-enhance-your-machine-learning-presentation)
51+
52+
## Example Presentations
53+
* [Bike Map - Using Computer Vision for Bike Routing](https://www.youtube.com/watch?v=nNMmz6Ei9Qg)
54+
* [AI Font Generator](https://www.youtube.com/watch?v=nNMmz6Ei9Qg)
55+
* [Art Speak Simplifier](https://www.youtube.com/watch?v=laG4MiNRX54)
56+
* [Career Changer App](https://www.youtube.com/watch?v=laG4MiNRX54)
57+
* [Roof Segmentation for Efficient Solar Panel Placement](https://www.youtube.com/watch?v=8tBwanAYA90)

0 commit comments

Comments
 (0)