File tree Expand file tree Collapse file tree 17 files changed +33
-24
lines changed Expand file tree Collapse file tree 17 files changed +33
-24
lines changed Original file line number Diff line number Diff line change 30
30
<a href="https://ragrank.readthedocs.io/latest/">Documentation</a> |
31
31
<a href="https://api-ragrank.readthedocs.io/">API reference</a> |
32
32
<a href="https://ragrank.readthedocs.io/latest/get_started/basic_evaluation.html">Quickstart</a> |
33
- <a href="https://discord.gg/yaFRx6ja ">Join the Community</a>
33
+ <a href="https://discord.gg/KzfVpds3 ">Join the Community</a>
34
34
<p>
35
35
</h4 >
36
36
@@ -73,7 +73,7 @@ data = from_dict({
73
73
})
74
74
75
75
# Evaluate the response relevance metric
76
- result = evaluate(data = data , metrics = [response_relevancy])
76
+ result = evaluate(data, metrics = [response_relevancy])
77
77
78
78
# Display the evaluation results
79
79
result.to_dataframe()
Original file line number Diff line number Diff line change 8
8
project = "Ragrank"
9
9
copyright = "2024, Izam Mohammed"
10
10
author = "Izam Mohammed"
11
- release = "0.0.6 "
11
+ release = "0.0.7 "
12
12
13
13
14
14
# -- General configuration ---------
Original file line number Diff line number Diff line change 9
9
project = "Ragrank"
10
10
copyright = "2024, Izam Mohammed"
11
11
author = "Izam Mohammed"
12
- release = "0.0.6 "
12
+ release = "0.0.7 "
13
13
14
14
15
15
# -- General configuration ------
Original file line number Diff line number Diff line change @@ -17,7 +17,7 @@ data = DataNode(
17
17
)
18
18
19
19
result:EvalResult = evaluate(
20
- dataset = data,
20
+ data ,
21
21
)
22
22
23
23
print (result.to_dict())
Original file line number Diff line number Diff line change @@ -29,7 +29,7 @@ llm_configuration = LLMConfig(
29
29
llm = OpenaiLLM(llm_config = llm_configuration)
30
30
31
31
result = evaluate(
32
- dataset = data,
32
+ data ,
33
33
llm = llm,
34
34
)
35
35
@@ -72,7 +72,7 @@ data = DataNode(
72
72
)
73
73
74
74
result = evaluate(
75
- dataset = data,
75
+ data ,
76
76
llm = ragrank_llm,
77
77
)
78
78
```
Original file line number Diff line number Diff line change @@ -45,7 +45,7 @@ data = DataNode(
45
45
46
46
# evaluating the metrics
47
47
result = evaluate(
48
- data = data ,
48
+ data ,
49
49
metrics = [
50
50
response_relevancy,
51
51
response_conciseness,
Original file line number Diff line number Diff line change @@ -29,7 +29,7 @@ data = from_dict({
29
29
})
30
30
31
31
# Evaluate the response relevance metric
32
- result = evaluate(data = data , metrics = [response_relevancy])
32
+ result = evaluate(data, metrics = [response_relevancy])
33
33
34
34
# Display the evaluation results
35
35
result.to_dataframe()
Original file line number Diff line number Diff line change @@ -24,7 +24,7 @@ data = DataNode(
24
24
)
25
25
26
26
result = evaluate(
27
- dataset = data,
27
+ data ,
28
28
metrics = [
29
29
response_relevancy,
30
30
]
Original file line number Diff line number Diff line change @@ -25,7 +25,7 @@ data = DataNode(
25
25
)
26
26
27
27
result = evaluate(
28
- dataset = data,
28
+ data ,
29
29
metrics = [
30
30
response_relevancy,
31
31
]
Original file line number Diff line number Diff line change @@ -57,7 +57,7 @@ data = DataNode(
57
57
)
58
58
59
59
result = evaluate(
60
- dataset = data,
60
+ data ,
61
61
metrics = [grammar_checker],
62
62
)
63
63
print (result)
Original file line number Diff line number Diff line change @@ -42,7 +42,7 @@ data = DataNode(
42
42
)
43
43
44
44
result = evaluate(
45
- dataset = data,
45
+ data ,
46
46
metrics = [
47
47
my_metric,
48
48
]
Original file line number Diff line number Diff line change @@ -25,7 +25,7 @@ data = DataNode(
25
25
)
26
26
27
27
result = evaluate(
28
- dataset = data,
28
+ data ,
29
29
metrics = [
30
30
response_conciseness,
31
31
]
Original file line number Diff line number Diff line change @@ -25,7 +25,7 @@ data = DataNode(
25
25
)
26
26
27
27
result = evaluate(
28
- dataset = data,
28
+ data ,
29
29
metrics = [
30
30
response_relevancy,
31
31
]
Original file line number Diff line number Diff line change 34
34
**5. Test Your Changes:**
35
35
- Run tests to ensure your changes haven't introduced any regressions:
36
36
```
37
- pytest
37
+ make test
38
38
```
39
39
40
- **6. Commit Your Changes:**
40
+ **6. Linting and formating:**
41
+ - Format the code
42
+ ```
43
+ make format
44
+ ```
45
+ - Check the linting
46
+ ```
47
+ make lint
48
+ ```
49
+ **7. Commit Your Changes:**
41
50
- Once you're satisfied with your changes, commit them:
42
51
```
43
52
git add .
44
53
git commit -m "Add your descriptive commit message here"
45
54
```
46
55
47
- **7 . Push Changes to Your Fork:**
56
+ **8 . Push Changes to Your Fork:**
48
57
- Push your changes to your forked repository:
49
58
```
50
59
git push origin my-feature
51
60
```
52
61
53
- **8 . Create a Pull Request:**
62
+ **9 . Create a Pull Request:**
54
63
- Go to your forked repository on GitHub.
55
64
- Click on the "Compare & pull request" button next to your branch.
56
65
- Fill out the pull request form with a descriptive title and details of your changes.
57
66
- Click on the "Create pull request" button to submit your contribution.
58
67
59
- **9 . Collaborate and Iterate:**
68
+ **10 . Collaborate and Iterate:**
60
69
- Engage with reviewers and address any feedback or requests for changes.
61
70
- Iterate on your code until it meets the project's standards and requirements.
62
71
63
- **10 . Stay Updated:**
72
+ **11 . Stay Updated:**
64
73
- Keep an eye on the pull request for any updates or requests from maintainers.
65
74
- Stay engaged with the Ragrank community and contribute to discussions and future development efforts.
66
75
Original file line number Diff line number Diff line change 1
1
[tool .poetry ]
2
2
name = " ragrank"
3
- version = " 0.0.6 "
3
+ version = " 0.0.7 "
4
4
description = " An evaluation library for RAG models"
5
5
authors = [" Izam Mohammed <izamdeveloper1@gmail.com>" ]
6
6
license = " Apache-2.0"
Original file line number Diff line number Diff line change 1
- __version__ : str = "0.0.6 "
1
+ __version__ : str = "0.0.7 "
Original file line number Diff line number Diff line change 16
16
RESPONSE_FIELD ,
17
17
]
18
18
19
- SERVER_URL : str = "https://ragrank-trace.vercel.app /"
19
+ SERVER_URL : str = "https://ragrank-trace.onrender.com/api /"
20
20
DEBUG_MODE : str = "DEBUG_MODE_ON"
21
21
REQUEST_TIME_OUT : float = 10.0
You can’t perform that action at this time.
0 commit comments