OPENAI_API_KEY

NEO4J_CONNECTION_URI

NEO4J_USERNAME

NEO4J_PASSWORD

In this GraphRAG course, you will learn how to use a knowledge graph to implement an RAG application with Neo4j and OpenAI ChatGPT, enhancing response accuracy and reducing hallucinations.

Generative AI with LLMs and Knowledge Graphs using Neo4j.png

neo4jllmkgstreamlit.tar.gz

runPythonCode

runningneo4j-live

runningneo4j-streamlit

runPythonCode-Live

kg_generation_app

Graph_RAG_app

Knowledge graphs are powerful tools that structure information into entities and relationships, making data more accessible and meaningful for AI applications. They are essential for enhancing the performance of LLMs by providing structured context, improving response accuracy and cohesiveness, and reducing hallucinations on datasets outside the LLM’s training data.

In this course, you’ll explore knowledge graphs for retrieval-augmented generation (RAG) and dive deep into traditional to advanced NER and relationship extraction techniques. You’ll learn to construct and refine knowledge graphs from raw text, store and query them effectively with Neo4j, and integrate them with LLMs to boost their performance and build personalized chatbots using custom datasets.

After completing this course, you’ll gain expertise in implementing graph RAG for complex scenarios, advancing your skills in building generative AI applications.

Master Knowledge Graph Retrieval-Augmented Generation with Neo4j

from neo4j import GraphDatabase

class Neo4jHandler:
    def __init__(self, connection_uri, username, password):
        self.driver = GraphDatabase.driver(connection_uri, auth=(username, password))
    
    def close(self):
        self.driver.close()
    
    def store_entities_relationships(self, entities, relationships):
        with self.driver.session() as session:
            # Store entities
            for entity in entities:
                session.write_transaction(self._create_entity_node, entity)
            
            # Store relationships
            for entity1, relationship, entity2 in relationships:
                session.write_transaction(self._create_relationship, entity1, relationship, entity2)

    @staticmethod
    def _create_entity_node(tx, entity):
        query = "MERGE (e:Entity {name: $entity_name})"
        tx.run(query, entity_name=entity)

    @staticmethod
    def _create_relationship(tx, entity1, relationship, entity2):
        query = """
        MATCH (e1:Entity {name: $entity1})
        MATCH (e2:Entity {name: $entity2})
        MERGE (e1)-[:RELATION {type: $relationship}]->(e2)
        """
        tx.run(query, entity1=entity1, entity2=entity2, relationship=relationship)


ArticleTitle	Question	Answer	DifficultyFromQuestioner	DifficultyFromAnswerer	ArticleFile
Abraham_Lincoln	Was Abraham Lincoln the sixteenth President of the United States?	yes	easy	easy	S08_set3_a4
Abraham_Lincoln	Was Abraham Lincoln the sixteenth President of the United States?	Yes.	easy	easy	S08_set3_a4
Abraham_Lincoln	Did Lincoln sign the National Banking Act of 1863?	yes	easy	medium	S08_set3_a4
Abraham_Lincoln	Did Lincoln sign the National Banking Act of 1863?	Yes.	easy	easy	S08_set3_a4
Abraham_Lincoln	Did his mother die of pneumonia?	no	easy	medium	S08_set3_a4
Abraham_Lincoln	Did his mother die of pneumonia?	No.	easy	easy	S08_set3_a4
Abraham_Lincoln	How many long was Lincoln's formal education?	18 months	medium	easy	S08_set3_a4
Abraham_Lincoln	How many long was Lincoln's formal education?	18 months.	medium	medium	S08_set3_a4
Abraham_Lincoln	When did Lincoln begin his political career?	1832	medium	easy	S08_set3_a4
Abraham_Lincoln	When did Lincoln begin his political career?	1832.	medium	medium	S08_set3_a4
Abraham_Lincoln	What did The Legal Tender Act of 1862 establish?	the United States Note, the first paper currency in United States history	medium	easy	S08_set3_a4
Abraham_Lincoln	What did The Legal Tender Act of 1862 establish?	The United States Note, the first paper currency in United States history.	medium	medium	S08_set3_a4
Abraham_Lincoln	Who suggested Lincoln grow a beard?	11-year-old Grace Bedell	hard	medium	S08_set3_a4
Abraham_Lincoln	Who suggested Lincoln grow a beard?	Grace Bedell.	hard	medium	S08_set3_a4
Abraham_Lincoln	When did the Gettysburg address argue that America was born?	1776	hard	hard	S08_set3_a4
Abraham_Lincoln	When did the Gettysburg address argue that America was born?	1776.	hard	hard	S08_set3_a4
Abraham_Lincoln	Did Lincoln beat John C. Breckinridge in the 1860 election?	yes	hard	medium	S08_set3_a4
Abraham_Lincoln	Did Lincoln beat John C. Breckinridge in the 1860 election?	Yes.	hard	hard	S08_set3_a4
Abraham_Lincoln	Was Abraham Lincoln the first President of the United States?	No	easy	easy	S08_set3_a4
Abraham_Lincoln	Was Abraham Lincoln the first President of the United States?	No	easy	medium	S08_set3_a4
Abraham_Lincoln	Did Lincoln start his political career in 1832?	Yes	easy	easy	S08_set3_a4
Abraham_Lincoln	Did Lincoln start his political career in 1832?	Yes	easy	easy	S08_set3_a4
Abraham_Lincoln	Did Lincoln ever represent Alton & Sangamon Railroad?	Yes	easy	easy	S08_set3_a4
Abraham_Lincoln	Did Lincoln ever represent Alton & Sangamon Railroad?	Yes	easy	easy	S08_set3_a4
Abraham_Lincoln	Which county was Lincoln born in?	Hardin County	medium	medium	S08_set3_a4
Abraham_Lincoln	Which county was Lincoln born in?	Southeast Hardin County, Kentucky	medium	medium	S08_set3_a4
Abraham_Lincoln	When did Lincoln first serve as President?	March 4, 1861	medium	hard	S08_set3_a4
Abraham_Lincoln	When did Lincoln first serve as President?	March 4, 1861	medium	medium	S08_set3_a4
Abraham_Lincoln	Who assassinated Lincoln?	John Wilkes Booth	medium	hard	S08_set3_a4
Abraham_Lincoln	Who assassinated Lincoln?	John Wilkes Booth	medium	hard	S08_set3_a4
Abraham_Lincoln	Did Lincoln win the election of 1860?	Yes	hard	hard	S08_set3_a4
Abraham_Lincoln	Did Lincoln win the election of 1860?	Yes	hard	too hard	S08_set3_a4
Abraham_Lincoln	Who was the general in charge at the Battle of Antietam?	General McClellan	hard	medium	S08_set3_a4
Abraham_Lincoln	Who was the general in charge at the Battle of Antietam?	John Alexander McClernand	hard	medium	S08_set3_a4
Abraham_Lincoln	Why did Lincoln issue the Emancipation Proclamation?	To free slaves 	hard	hard	S08_set3_a4
Abraham_Lincoln	Why did Lincoln issue the Emancipation Proclamation?	The goal was to weaken the rebellion, which was led and controlled by slave owners.	hard	hard	S08_set3_a4
Abraham_Lincoln	Do scholars rank lincoln among the top three presidents?	NULL	easy	NULL	S08_set3_a4
Abraham_Lincoln	Do scholars rank lincoln among the top three presidents?	Yes	easy	easy	S08_set3_a4
Abraham_Lincoln	Did lincoln have 18 months of schooling?	NULL	easy	NULL	S08_set3_a4
Abraham_Lincoln	Did lincoln have 18 months of schooling?	Yes	easy	easy	S08_set3_a4
Abraham_Lincoln	Was Lincoln chosen as a presidential candidate in 1860?	NULL	easy	NULL	S08_set3_a4
Abraham_Lincoln	Was Lincoln chosen as a presidential candidate in 1860?	Yes	easy	easy	S08_set3_a4
Abraham_Lincoln	How old was Lincoln in 1816?	NULL	medium	NULL	S08_set3_a4
Abraham_Lincoln	How old was Lincoln in 1816?	seven	medium	medium	S08_set3_a4
Abraham_Lincoln	When was the first photgraph of lincoln taken?	NULL	medium	NULL	S08_set3_a4
Abraham_Lincoln	When was the first photgraph of lincoln taken?	1846	medium	medium	S08_set3_a4
Abraham_Lincoln	How long was Lincoln's legal Career?	NULL	medium	NULL	S08_set3_a4
Abraham_Lincoln	How long was Lincoln's legal Career?	23 years	medium	medium	S08_set3_a4
Abraham_Lincoln	What trail did Lincoln use a Farmers' Almanac in? 	NULL	hard	NULL	S08_set3_a4
Abraham_Lincoln	What trail did Lincoln use a Farmers' Almanac in? 	he defended William "Duff" Armstrong	hard	hard	S08_set3_a4
Abraham_Lincoln	Did Abraham Lincoln live in the Frontier?	NULL	hard	NULL	S08_set3_a4
Abraham_Lincoln	Did Abraham Lincoln live in the Frontier?	Yes	hard	medium	S08_set3_a4
Abraham_Lincoln	Did Lincoln's Wife's Family support slavery?	NULL	hard	NULL	S08_set3_a4
Abraham_Lincoln	Did Lincoln's Wife's Family support slavery?	Yes	hard	medium	S08_set3_a4
Alessandro_Volta	Volta became professor of physics in the Como high school in what year?	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	What ac phaenomenis inde pendentibus?	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	What may be called Volta's Law of the electrochemical series?	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	Is it true that volta became professor of physics?	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	Is it true that volta entered retirement in spain?	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	When did he become professor?	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	What did Alessandro Volta publish in 1800?	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	Is Volta buried in the city of Como?	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	Is the electrolyte sulphuric acid?	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta		NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta		NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta		NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	NOTTTT  FOUND	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta		NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta		NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	Are Count Volta 's original instruments and papers on display there ?	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	Is Volta buried in the city of Como ?	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	Was his 1800 paper written in French ?	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	Are Count Volta 's original instruments and papers on display there ?	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	Did he not realize that the frog 's leg served as both a conductor of electricity -LRB- we would now call it an electrolyte -RRB- and as a detector of electricity ?	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	Does this not make the zinc rod the negative electrode and the copper rod the positive electrode ?	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	What happened with $ its invention?	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	HWhat happened at the electromotive force -LRB- emf -RRB- of a galvanic cell?	NULL	NULL	NULL	S08_set4_a10
Alessandro_Volta	What happened in 1800?	NULL	NULL	NULL	S08_set4_a10
Amedeo_Avogadro	What was an Italian savant?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	What was an Italian savant?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Who is most noted for his contributions to the theory of molarity and molecular weight?	Amedeo Avogadro	NULL	medium	S08_set4_a8
Amedeo_Avogadro	Who is most noted for his contributions to the theory of molarity and molecular weight?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Who is most noted for his contributions to the theory of molarity and molecular weight?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Who graduated in ecclesiastical law at the early age of 20 and began to practice?	Amedeo Avogadro	NULL	medium	S08_set4_a8
Amedeo_Avogadro	Who graduated in ecclesiastical law at the early age of 20 and began to practice?	blah	NULL	easy	S08_set4_a8
Amedeo_Avogadro	Who graduated in ecclesiastical law at the early age of 20 and began to practice?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	When did he publish another memoria?	1821	NULL	medium	S08_set4_a8
Amedeo_Avogadro	When did he publish another memoria?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	When did he publish another memoria?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	When did he become a professor?	1820	NULL	medium	S08_set4_a8
Amedeo_Avogadro	When did he become a professor?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	When did he become a professor?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Is it true that he became a professor in 1820?	yes	NULL	easy	S08_set4_a8
Amedeo_Avogadro	Is it true that he became a professor in 1820?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Is it true that he became a professor in 1820?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Was Lorenzo Romano Amedeo Carlo Avogadro an Italian savant?	yes	NULL	easy	S08_set4_a8
Amedeo_Avogadro	Was Lorenzo Romano Amedeo Carlo Avogadro an Italian savant?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Was Lorenzo Romano Amedeo Carlo Avogadro an Italian savant?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Was Amedeo Avogadro born in Turin August 9th 1776 to a noble ancient family of Piedmont, Italy?	yes	NULL	easy	S08_set4_a8
Amedeo_Avogadro	Was Amedeo Avogadro born in Turin August 9th 1776 to a noble ancient family of Piedmont, Italy?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Was Amedeo Avogadro born in Turin August 9th 1776 to a noble ancient family of Piedmont, Italy?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Is he most noted for his contributions to the theory of molarity and molecular weight?	yes	NULL	easy	S08_set4_a8
Amedeo_Avogadro	Is he most noted for his contributions to the theory of molarity and molecular weight?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Is he most noted for his contributions to the theory of molarity and molecular weight?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro		NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro		NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro		NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro		NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro		NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro		NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Who confirm that he sponsored and helped some Sardinian plotters who were organising a revolution in that island , stopped at the very last moment by the concession of Charles Albert 's statute ?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Who confirm that he sponsored and helped some Sardinian plotters who were organising a revolution in that island , stopped at the very last moment by the concession of Charles Albert 's statute ?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	He is what?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	He is what?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	The unification of Italy did what?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Was King Victor Emmanuel III there to pay homage to Avogadro ?	yes	NULL	easy	S08_set4_a8
Amedeo_Avogadro	Was King Victor Emmanuel III there to pay homage to Avogadro ?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Was King Victor Emmanuel III there to pay homage to Avogadro ?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Is Avogadro 's number commonly used to compute the results of chemical reactions ?	yes	NULL	easy	S08_set4_a8
Amedeo_Avogadro	Is Avogadro 's number commonly used to compute the results of chemical reactions ?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Is Avogadro 's number commonly used to compute the results of chemical reactions ?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Is it approximately 6.0221415 10 23 ?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Is it approximately 6.0221415 10 23 ?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Did the scientific community not reserve great attention to his theory ?	yes	NULL	easy	S08_set4_a8
Amedeo_Avogadro	Did the scientific community not reserve great attention to his theory ?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Did the scientific community not reserve great attention to his theory ?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Does it not allow chemists to determine the exact amounts of substances produced in a given reaction ?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Does it not allow chemists to determine the exact amounts of substances produced in a given reaction ?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Was King Victor Emmanuel III there to pay homage to Avogadro ?	yes	NULL	easy	S08_set4_a8
Amedeo_Avogadro	Was King Victor Emmanuel III there to pay homage to Avogadro ?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Was King Victor Emmanuel III there to pay homage to Avogadro ?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Can the title of this famous 1811 paper be roughly translated into english?	yes	NULL	easy	S08_set4_a8
Amedeo_Avogadro	Can the title of this famous 1811 paper be roughly translated into english?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	Can the title of this famous 1811 paper be roughly translated into english?		NULL		S08_set4_a8
Amedeo_Avogadro	What happened in french?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	What happened in french?		NULL	hard	S08_set4_a8
Amedeo_Avogadro	What happened in 1833?	Avogadro had been recalled to Turin university	NULL	medium	S08_set4_a8
Amedeo_Avogadro	What happened in 1833?	NULL	NULL	NULL	S08_set4_a8
Amedeo_Avogadro	What happened in 1833?	blah blah blah	NULL	hard	S08_set4_a8
Anders_Celsius	Who determined the dependence of the boiling of water with atmospheric pressure?	Anders Celsius	NULL	medium	S08_set4_a5
Anders_Celsius	What is named after him?	The Celsius crater on the Moon	NULL	medium	S08_set4_a5
Anders_Celsius	When did he publish a collection?	1733	NULL	easy	S08_set4_a5
Anders_Celsius	Is it true that he published a collection in 1738?	No	NULL	easy	S08_set4_a5
Anders_Celsius	Is it true that thermometer had 100 for the freezing point?	Yes	NULL	easy	S08_set4_a5
Anders_Celsius	Was Celsius born in Uppsala in Sweden?	Yes	NULL	easy	S08_set4_a5
Anders_Celsius	Was Anders Celsius (November 27, 1701 April 25, 1744) a Swedish astronomer?	Yes	NULL	easy	S08_set4_a5
Anders_Celsius	Is The Celsius crater on the Moon named after him?	Yes	NULL	easy	S08_set4_a5
Anders_Celsius	Who was the first to perform and publish careful experiments aiming at the definition of an international temperature scale on scientific grounds ?	Anders Celsius	NULL	medium	S08_set4_a5
Anders_Celsius	The Celsius crater on the Moon is what?	named after him	NULL	medium	S08_set4_a5
Anders_Celsius	Is the Celsius crater on the Moon named after him ?	Yes	NULL	easy	S08_set4_a5
Anders_Celsius	Had his thermometer 100 for the freezing point of water and 0 for the boiling point ?	Yes it had	NULL	easy	S08_set4_a5
Anders_Celsius	Was Celsius born in Uppsala in Sweden ?	Yes	NULL	easy	S08_set4_a5
Anders_Celsius	Is the Celsius crater on the Moon named after him ?	Yes	NULL	easy	S08_set4_a5
Anders_Celsius	Did he not determine the dependence of the boiling of water with atmospheric pressure -LRB- in excellent agreement with modern data -RRB- ?	Yes he did	NULL	easy	S08_set4_a5
Anders_Celsius	What happened from 1730 to 1744?	He was professor of astronomy at Uppsala University	NULL	easy	S08_set4_a5
Anders_Celsius	What happened in 1745?	The scale was reversed	NULL	medium	S08_set4_a5

from openai import OpenAI
client = OpenAI(api_key="{{OPENAI_API_KEY}}")

def convert_to_chunks(file_path, max_words_per_chunk):
  chunks = []
  current_chunk = []
  current_word_count = 0
    
  with open(file_path, "r") as file:
    for line in file:
      words = line.split()
      current_word_count += len(words)
      if current_word_count < max_words_per_chunk:
        current_chunk.append(line.strip())
      else:
        chunks.append(' '.join(current_chunk))
        current_chunk = []
        current_word_count = 0
        current_word_count += len(words)
        current_chunk.append(line.strip())
    
    # Add any remaining text in the last chunk
    if current_chunk:
      chunks.append(' '.join(current_chunk))
    print("\nChunks created.\n")
    return chunks

def extract_entities_relationships(text):
    messages = [
    {"role": "system", "content": """"
    You are a helper tool for a knowedge graph builder application. Your task is to extract entities and relationships from the text provided by the user. 
    Format the output in such a way that it can be directly parsed into Python lists. 
    The format should include:
    
    1. A list of **Entities** in Python list format.
    2. A list of **Relationships**, where each relationship is represented as a tuple in the format: (Entity 1, "Relationship", Entity 2).
    
    Here is the format to follow:
    
    Entities: ["Entity 1", "Entity 2", ..., "Entity N"]
    
    Relationships: [("Entity 1", "Relationship", "Entity 2"), ..., ("Entity X", "Relationship", "Entity Y")]
    
    Example Input:
    Extract entities and relationships from the following text:
    "Michael Jackson, born in Gary, Indiana, was a famous singer known as the King of Pop. He passed away in Los Angeles in 2009."
    
    Expected Output:
    
    Entities: ["Michael Jackson", "Gary, Indiana", "Los Angeles", "singer", "King of Pop", "2009"]
    
    Relationships: [
      ("Michael Jackson", "born in", "Gary, Indiana"), 
      ("Michael Jackson", "profession", "singer"), 
      ("Michael Jackson", "referred to as", "King of Pop"), 
      ("Michael Jackson", "passed away in", "Los Angeles"), 
      ("Michael Jackson", "date of death", "2009")
    ]
    """},
    {"role": "user", "content": f"Extract entities and relationship tuples from the following text:\n\n{text}\n\n"}
    ]
  
    response = client.chat.completions.create(
        model="gpt-4",
        messages=messages,
    )
    response_content = response.choices[0].message.content
    return response_content

import ast
def parse_llm_response_content(content):
    """
    Parse the LLM output to extract entities and relationships.
    """
    entity_section = content.split("Entities:")[1].split("Relationships:")[0].strip()
    relationship_section = content.split("Relationships:")[1].strip()

    entities = ast.literal_eval(entity_section)
    relationships = ast.literal_eval(relationship_section)
    
    return entities, relationships

def get_entities_relationships(file_path, wordsPerChunk=2665):
    """
    Chunk the input text, process each chunk, and combine results.
    """
    chunks = convert_to_chunks(file_path, wordsPerChunk)
    all_entities = []
    all_relationships = []
    i=1
    print("Number of chunks: ", len(chunks))
    for chunk in chunks:
        # Extract entities and relationships for each chunk
        content = extract_entities_relationships(chunk)
        print("Entities and realtionships have been extracted successfully for chunk ", i, ".\n")
        entities, relationships = parse_llm_response_content(content)
        print("Entities and realtionships have been parsed successfully for chunk ", i, ".\n")
        i=i+1
        # Aggregate entities and relationships
        all_entities.extend(entities)
        all_relationships.extend(relationships)
    
    # Remove duplicates from entities
    all_entities = list(set(all_entities))
    print("All entities and realtionships have been extracted successfully.")
    return all_entities, all_relationships

import networkx as nx
import matplotlib.pyplot as plt
import streamlit as st

# Function to build and plot the knowledge graph
def plot_knowledge_graph(entities, relationships):
    G = nx.DiGraph()
    
    # Add relationships as edges to the graph
    for entity1, relationship, entity2 in relationships:
        G.add_edge(entity1, entity2, label=relationship)

    pos = nx.spring_layout(G)
    plt.figure(figsize=(10, 8))
    
    # Draw the graph with labels
    nx.draw(G, pos, with_labels=True, node_color='skyblue', node_size=5000, edge_color='black', font_size=10)
    
    # Add edge labels
    edge_labels = {(entity1, entity2): relationship for entity1, relationship, entity2 in relationships}
    nx.draw_networkx_edge_labels(G, pos, edge_labels=edge_labels, font_color='red')
    
    plt.title("Knowledge Graph")
    st.pyplot(plt)

import streamlit as st
from entity_relationship_extraction import get_entities_relationships
from visualize_graph import plot_knowledge_graph
from neo4j_db import Neo4jHandler

# Streamlit app
st.title("Knowledge Graph Generator from Raw Text")

# Read raw text from an existing file in the same directory
st.write("Reading raw_text file...")
text_file_path = "/usercode/raw_text.txt"
wordsPerChunk = 2665

# Extract entities and relationships from the raw text
with st.spinner("Extracting entities and relationships..."):
    entities, relationships = get_entities_relationships(text_file_path, wordsPerChunk)

# Display the extracted entities and relationships
st.write("### Extracted Entities")
st.write(entities)

st.write("### Extracted Relationship Tuples")
st.write(relationships)

# Display the knowledge graph
st.write("### Knowledge Graph")
plot_knowledge_graph(entities, relationships)

# Neo4j connection details
neo4j_uri = "{{NEO4J_CONNECTION_URI}}"  
neo4j_user = "{{NEO4J_USERNAME}}"
neo4j_password = "{{NEO4J_PASSWORD}}"

# Button to store entities and relationships in Neo4j
if st.button("Store entities and relationships to Neo4j"):
    with st.spinner("Storing entities and relationships to Neo4j..."):
        neo4j_handler = Neo4jHandler(neo4j_uri, neo4j_user, neo4j_password)
        neo4j_handler.store_entities_relationships(entities, relationships)
        neo4j_handler.close()
    st.success("Entities and relationships successfully stored in Neo4j!")


import React from 'react';
import { shallow, configure } from 'enzyme';
import Adapter from 'enzyme-adapter-react-16';

configure({ adapter: new Adapter() });

import HelloWorld from './app';

var TestResult = function() {
    this.succeeded = false;
    this.reason = "";
    this.input = "";
    this.expected_output = "";
    this.actual_output = "";
}

export const executeTests = function() {

  var results = [];

  result = new TestResult();
  result.input = 'HelloWorld Component';
  result.expected_output = "span containing text 'Hello World'"

  let wrapper = shallow(<HelloWorld />);

  // Call your Challenge function here.

  let type = wrapper.type();
  let testSuccessful = true;
  let failureReason;

  if (type !== 'span') {
    testSuccessful = false;
    failureReason = "You need to render exactly one span HTML element";
  } else if (wrapper.props().children != "Hello World") {
     testSuccessful = false;
     failureReason = "You have rendered wrong message in your span element";
  }

  result.actual_output = wrapper.html();

  if (testSuccessful) {
    result.succeeded = true;
    result.reason = "Succeeded"
  } else {
    result.succeeded = false;
    result.reason = failureReason;
  }

  results.push(result);

  return results;
}


React

Dart

GoJS React

Typescript React

Vue.js

Learn how to write modular code to store a large number of LLM-extracted entities and relationships for our dataset in Neo4j.

Introduction to the Course

Constructing Knowledge Graphs

Create a Knowledge Graph from Text

Neo4j: Storing Entities and Relationships to Graph Database

Integrating Knowledge Graphs with LLMs

Storing LLM Extracted Entities and Relationships in Neo4j