-
Notifications
You must be signed in to change notification settings - Fork 123
docs(integration): Add and update integration files for langchain-hana (graphs, chains) #766
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
VarinThakur01
wants to merge
4
commits into
langchain-ai:main
Choose a base branch
from
VarinThakur01:sap-update-docs
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from 2 commits
Commits
Show all changes
4 commits
Select commit
Hold shift + click to select a range
6dbb5ae
Update documentation for sap
VarinThakur01 92f739a
Merge branch 'main' into sap-update-docs
mdrxy 981e4c1
Remove unneccessary parameter from db instance creation
VarinThakur01 471cfe8
Remove unneccessary parameters in db connection creation
VarinThakur01 File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
339 changes: 339 additions & 0 deletions
339
src/oss/python/integrations/chains/sap_hana_sparql_qa_chain.mdx
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,339 @@ | ||
--- | ||
title: QA over Knowledge Graphs with SAP HANA Cloud Knowledge Graph Engine | ||
--- | ||
## Setup and Installation | ||
|
||
To use this feature, install the `langchain-hana` package: | ||
|
||
```python | ||
pip install langchain_hana | ||
``` | ||
|
||
And then, create a connection to your SAP HANA Cloud instance. | ||
|
||
```python | ||
import os | ||
|
||
from dotenv import load_dotenv | ||
from hdbcli import dbapi | ||
|
||
# Load environment variables if needed | ||
load_dotenv() | ||
|
||
# Establish connection to SAP HANA Cloud | ||
connection = dbapi.connect( | ||
address=os.environ.get("HANA_DB_ADDRESS"), | ||
port=os.environ.get("HANA_DB_PORT"), | ||
user=os.environ.get("HANA_DB_USER"), | ||
password=os.environ.get("HANA_DB_PASSWORD"), | ||
autocommit=True, | ||
sslValidateCertificate=False, | ||
) | ||
``` | ||
|
||
`HanaSparqlQAChain` ties together: | ||
|
||
1. **Schema-aware SPARQL generation** | ||
2. **Query execution** against SAP HANA | ||
3. **Natural-language answer formatting** | ||
|
||
## Initialization | ||
|
||
You need: | ||
|
||
* An **LLM** to generate and interpret queries | ||
* A **`HanaRdfGraph`** (with connection, `graph_uri`, and ontology) | ||
|
||
Follow the steps here [HanaRdfGraph](/oss/integrations/graphs/sap_hana_rdf_graph) to know more about creating a `HanaRdfGraph` instance. | ||
|
||
Import the HanaSparqlQAChain | ||
|
||
```python | ||
from langchain_hana import HanaSparqlQAChain | ||
``` | ||
|
||
```python | ||
qa_chain = HanaSparqlQAChain.from_llm( | ||
llm=llm, graph=graph, allow_dangerous_requests=True, verbose=True | ||
) | ||
``` | ||
|
||
## Pipeline Overview | ||
|
||
1. **SPARQL Generation** | ||
* Uses `SPARQL_GENERATION_SELECT_PROMPT` | ||
* Inputs: | ||
* `schema` (Turtle from `graph.get_schema`) | ||
* `prompt` (user’s question) | ||
2. **Query Post-processing** | ||
* Extracts the SPARQL code from the llm output. | ||
* Inject `FROM <graph_uri>` if missing | ||
* Ensure required common prefixes are declared (`rdf:`, `rdfs:`, `owl:`, `xsd:`) | ||
3. **Execution** | ||
* Calls `graph.query(generated_sparql)` | ||
4. **Answer Formulation** x | ||
* Uses `SPARQL_QA_PROMPT` | ||
* Inputs: | ||
* `context` (raw query results) | ||
* `prompt` (original question) | ||
|
||
## Prompt Templates | ||
|
||
### "SPARQL Generation" prompt | ||
|
||
The `sparql_generation_prompt` is used to guide the LLM in generating a SPARQL query from the user question and the provided schema. | ||
|
||
### Answering prompt | ||
|
||
The `qa_prompt` instructs the LLM to create a natural language answer based solely on the database results. | ||
|
||
The default prompts can be found here: [`prompts.py`](https://github.com/SAP/langchain-integration-for-sap-hana-cloud/blob/main/langchain_hana/chains/graph_qa/prompts.py) | ||
|
||
## Customizing Prompts | ||
|
||
You can override the defaults at initialization: | ||
|
||
```python | ||
qa_chain = HanaSparqlQAChain.from_llm( | ||
llm=llm, | ||
graph=graph, | ||
allow_dangerous_requests=True, | ||
verbose=True, | ||
sparql_generation_prompt=YOUR_SPARQL_PROMPT, | ||
qa_prompt=YOUR_QA_PROMPT | ||
) | ||
``` | ||
|
||
Or swap them afterward: | ||
|
||
```python | ||
qa_chain.sparql_generation_chain.prompt = YOUR_SPARQL_PROMPT | ||
qa_chain.qa_chain.prompt = YOUR_QA_PROMPT | ||
``` | ||
|
||
> - `sparql_generation_prompt` must have the input variables: `["schema", "prompt"]` | ||
> - `qa_prompt` must have the input variables: `["context", "prompt"]` | ||
|
||
## Example: Question Answering over a “Movies” Knowledge Graph | ||
|
||
**Prerequisite**: | ||
You must have an SAP HANA Cloud instance with the **triple store** feature enabled. | ||
For detailed instructions, refer to: [Enable Triple Store](https://help.sap.com/docs/hana-cloud-database/sap-hana-cloud-sap-hana-database-knowledge-graph-guide/enable-triple-store/)<br /> | ||
Load the `kgdocu_movies` example data. See [Knowledge Graph Example](https://help.sap.com/docs/hana-cloud-database/sap-hana-cloud-sap-hana-database-knowledge-graph-guide/knowledge-graph-example). | ||
|
||
Below we’ll: | ||
|
||
1. Instantiate the `HanaRdfGraph` pointing at our “movies” data graph | ||
2. Wrap it in a `HanaSparqlQAChain` powered by an LLM | ||
3. Ask natural-language questions and print out the chain’s responses | ||
|
||
This demonstrates how the LLM generates SPARQL under the hood, executes it against SAP HANA, and returns a human-readable answer. | ||
|
||
We'll use the `sap-ai-sdk-gen` package. Currently still installed via: | ||
|
||
`pip install "sap-ai-sdk-gen[all]"` | ||
|
||
Please check [sap-ai-sdk-gen](https://pypi.org/project/sap-ai-sdk-gen/) for future releases. | ||
|
||
First, create a connection to your SAP HANA Cloud instance. | ||
|
||
```python | ||
import os | ||
|
||
from dotenv import load_dotenv | ||
from hdbcli import dbapi | ||
|
||
# Load environment variables if needed | ||
load_dotenv() | ||
|
||
# Establish connection to SAP HANA Cloud | ||
connection = dbapi.connect( | ||
address=os.environ.get("HANA_DB_ADDRESS"), | ||
port=os.environ.get("HANA_DB_PORT"), | ||
user=os.environ.get("HANA_DB_USER"), | ||
password=os.environ.get("HANA_DB_PASSWORD"), | ||
autocommit=True, | ||
sslValidateCertificate=False, | ||
) | ||
``` | ||
|
||
Then, set up the knowledge graph instance | ||
|
||
```python | ||
from gen_ai_hub.proxy.langchain.openai import ChatOpenAI | ||
from langchain_hana import HanaRdfGraph, HanaSparqlQAChain | ||
|
||
# from langchain_openai import ChatOpenAI # or your chosen LLM | ||
``` | ||
|
||
```python | ||
# Set up the Knowledge Graph | ||
graph_uri = "kgdocu_movies" | ||
|
||
graph = HanaRdfGraph( | ||
connection=connection, | ||
graph_uri=graph_uri, | ||
auto_extract_ontology=True | ||
) | ||
``` | ||
|
||
```python | ||
# a basic graph schema is extracted from the data graph. This schema will guide the LLM to generate a proper SPARQL query. | ||
print(graph.get_schema) | ||
``` | ||
|
||
```output | ||
@prefix owl: <http://www.w3.org/2002/07/owl#> . | ||
@prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#> . | ||
@prefix xsd: <http://www.w3.org/2001/XMLSchema#> . | ||
|
||
<http://kg.demo.sap.com/acted_in> a owl:ObjectProperty ; | ||
rdfs:label "acted_in" ; | ||
rdfs:domain <http://kg.demo.sap.com/Actor> ; | ||
rdfs:range <http://kg.demo.sap.com/Film> . | ||
|
||
<http://kg.demo.sap.com/dateOfBirth> a owl:DatatypeProperty ; | ||
rdfs:label "dateOfBirth" ; | ||
rdfs:domain <http://kg.demo.sap.com/Actor> ; | ||
rdfs:range xsd:dateTime . | ||
|
||
<http://kg.demo.sap.com/directed> a owl:ObjectProperty ; | ||
rdfs:label "directed" ; | ||
rdfs:domain <http://kg.demo.sap.com/Director> ; | ||
rdfs:range <http://kg.demo.sap.com/Film> . | ||
|
||
<http://kg.demo.sap.com/genre> a owl:ObjectProperty ; | ||
rdfs:label "genre" ; | ||
rdfs:domain <http://kg.demo.sap.com/Film> ; | ||
rdfs:range <http://kg.demo.sap.com/Genre> . | ||
|
||
<http://kg.demo.sap.com/placeOfBirth> a owl:ObjectProperty ; | ||
rdfs:label "placeOfBirth" ; | ||
rdfs:domain <http://kg.demo.sap.com/Actor> ; | ||
rdfs:range <http://kg.demo.sap.com/Place> . | ||
|
||
<http://kg.demo.sap.com/title> a owl:DatatypeProperty ; | ||
rdfs:label "title" ; | ||
rdfs:domain <http://kg.demo.sap.com/Film> ; | ||
rdfs:range xsd:string . | ||
|
||
rdfs:label a owl:DatatypeProperty ; | ||
rdfs:label "label" ; | ||
rdfs:domain <http://kg.demo.sap.com/Actor>, | ||
<http://kg.demo.sap.com/Director>, | ||
<http://kg.demo.sap.com/Genre>, | ||
<http://kg.demo.sap.com/Place> ; | ||
rdfs:range xsd:string . | ||
|
||
<http://kg.demo.sap.com/Director> a owl:Class ; | ||
rdfs:label "Director" . | ||
|
||
<http://kg.demo.sap.com/Genre> a owl:Class ; | ||
rdfs:label "Genre" . | ||
|
||
<http://kg.demo.sap.com/Place> a owl:Class ; | ||
rdfs:label "Place" . | ||
|
||
<http://kg.demo.sap.com/Actor> a owl:Class ; | ||
rdfs:label "Actor" . | ||
|
||
<http://kg.demo.sap.com/Film> a owl:Class ; | ||
rdfs:label "Film" . | ||
``` | ||
|
||
After that, initialise the LLM. | ||
|
||
```python | ||
# Initialize the LLM | ||
llm = ChatOpenAI(proxy_model_name="gpt-4o", temperature=0) | ||
``` | ||
|
||
Then, we create a SPARQL QA Chain | ||
|
||
```python | ||
# Create a SPARQL QA Chain | ||
chain = HanaSparqlQAChain.from_llm( | ||
llm=llm, | ||
verbose=True, | ||
allow_dangerous_requests=True, | ||
graph=graph, | ||
) | ||
``` | ||
|
||
```python | ||
# output = chain.invoke("Which movies are in the data?") | ||
# output = chain.invoke("In which movies did Keanu Reeves and Carrie-Anne Moss play in together") | ||
# output = chain.invoke("which movie genres are in the data?") | ||
# output = chain.invoke("which are the two most assigned movie genres?") | ||
# output = chain.invoke("where were the actors of "Blade Runner" born?") | ||
# output = chain.invoke("which actors acted together in a movie and were born in the same city?") | ||
output = chain.invoke("which actors acted in Blade Runner?") | ||
|
||
print(output["result"]) | ||
``` | ||
|
||
```output | ||
|
||
|
||
> Entering new HanaSparqlQAChain chain... | ||
Generated SPARQL: | ||
\`\`\` | ||
PREFIX kg: <http://kg.demo.sap.com/> | ||
PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> | ||
PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> | ||
SELECT ?actor ?actorLabel | ||
WHERE { | ||
?movie rdf:type kg:Film . | ||
?movie kg:title ?movieTitle . | ||
?actor kg:acted_in ?movie . | ||
?actor rdfs:label ?actorLabel . | ||
FILTER(?movieTitle = "Blade Runner") | ||
} | ||
\`\`\` | ||
Final SPARQL: | ||
|
||
PREFIX kg: <http://kg.demo.sap.com/> | ||
PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> | ||
PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> | ||
SELECT ?actor ?actorLabel | ||
|
||
FROM <kgdocu_movies> | ||
WHERE { | ||
?movie rdf:type kg:Film . | ||
?movie kg:title ?movieTitle . | ||
?actor kg:acted_in ?movie . | ||
?actor rdfs:label ?actorLabel . | ||
FILTER(?movieTitle = "Blade Runner") | ||
} | ||
|
||
Full Context: | ||
actor,actorLabel | ||
http://www.wikidata.org/entity/Q1353691,Morgan Paull | ||
http://www.wikidata.org/entity/Q1372770,William Sanderson | ||
http://www.wikidata.org/entity/Q358990,James Hong | ||
http://www.wikidata.org/entity/Q498420,M. Emmet Walsh | ||
http://www.wikidata.org/entity/Q81328,Q81328 | ||
http://www.wikidata.org/entity/Q723780,Brion James | ||
http://www.wikidata.org/entity/Q207596,Daryl Hannah | ||
http://www.wikidata.org/entity/Q1691628,Joe Turkel | ||
http://www.wikidata.org/entity/Q236702,Joanna Cassidy | ||
http://www.wikidata.org/entity/Q213574,Rutger Hauer | ||
http://www.wikidata.org/entity/Q3143555,Hy Pyke | ||
http://www.wikidata.org/entity/Q211415,Edward James Olmos | ||
http://www.wikidata.org/entity/Q230736,Sean Young | ||
|
||
|
||
> Finished chain. | ||
The actors who acted in Blade Runner are Morgan Paull, William Sanderson, James Hong, M. Emmet Walsh, Brion James, Daryl Hannah, Joe Turkel, Joanna Cassidy, Rutger Hauer, Hy Pyke, Edward James Olmos, and Sean Young. | ||
``` | ||
|
||
## What’s happening under the hood? | ||
|
||
1. **SPARQL Generation** | ||
The chain invokes the LLM with your Turtle-formatted ontology (`graph.get_schema`) and the user’s question using the `SPARQL_GENERATION_SELECT_PROMPT`. The LLM then emits a valid `SELECT` query tailored to your schema. | ||
2. **Pre-processing & Execution** | ||
* **Extract & clean**: Pull the raw SPARQL text out of the LLM’s response. | ||
* **Inject graph context**: Add `FROM <graph_uri>` if it’s missing and ensure common prefixes (`rdf:`, `rdfs:`, `owl:`, `xsd:`) are declared. | ||
* **Run on HANA**: Execute the finalized query via `HanaRdfGraph.query()` over your named graph. | ||
3. **Answer Formulation** | ||
The returned CSV (or Turtle) results feed into the LLM again—this time with the `SPARQL_QA_PROMPT`. The LLM produces a concise, human-readable answer strictly based on the retrieved data, without hallucination. |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
why is this False?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It is up to the user to enable/disable this feature while establishing the connection. So it is not dependent upon the example.