DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Newsletter
Log In / Join
Refcards Trend Reports
Events Video Library
Refcards
Trend Reports

Events

View Events Video Library

Related

  • Deploying AI With an Event-Driven Platform
  • Redis-Based Tomcat Session Management
  • Why Use LocalPV with NVMe for Your Workload?
  • AI-Era Cybersecurity, Part 1: Mapping Glasswing, Daybreak, Lightwell and the Tools Racing to Find and Fix Bugs

Trending

  • Architecture Review Boards for Generative AI: A Framework for Governance, Risk Management, and Responsible Adoption
  • Build a Voice Assistant With Gemini Live API
  • How to Write for DZone Publications: Trend Reports and Refcards
  • Going All In On the JVM 25 Virtual Threads

Draft This article hasn't been published, so readers can't see it.

In moderation This article is waiting for review, so readers can't see it yet.

Deleted This article has been deleted, so readers can't see it.

  1. DZone
  2. Data Engineering
  3. AI/ML
  4. Maintain Chat History in Generative AI Apps With Valkey

Maintain Chat History in Generative AI Apps With Valkey

This article presents a walkthrough on how to use a chat history component with Valkey, an open-source alternative to Redis.

By 
Abhishek Gupta
DZone Core CORE ·
Jul. 04, 24 · Tutorial
Post on X (opens in a new tab) Share on LinkedIn (opens in a new tab)
4.7K Views

Join the DZone community Save articles, join the discussion, and download Refcards and Trend Reports with a free account.

Join for free Already a member? Log in

A while back I wrote up a blog post on how to use Redis as a chat history component with LangChain. Since LangChain already had Redis chat history available as a component, it was quite convenient to write a client application.

But, that's not the same with langchaingo which is a Go port of LangChain. I am going to walk through how to do the same, but for Valkey (not Redis). Valkey is an open-source alternative to Redis. It's a community-driven, Linux Foundation project created to keep the project available for use and distribution under the open-source Berkeley Software Distribution (BSD) three-clause license after the Redis license changes.

I also wrote about a similar approach for DynamoDB as well as how to use Valkey with JavaScript

Refer to the Before You Begin section in this blog post to complete the prerequisites for running the examples. This includes installing Go, configuring Amazon Bedrock access, and providing necessary IAM permissions. The application uses the Anthropic Claude 3 Sonnet model on Amazon Bedrock.

Run the Chat Application

The chatbot is a simple CLI application. Before we run it, let's start a Valkey instance using the Valkey Docker image:

docker run --rm -p 6379:637 valkey/valkey


Also, head over to https://valkey.io/download to get OS-specific distribution, or use Homebrew (on Mac) — brew install valkey. You should now be able to use the Valkey CLI (valkey-cli).

Clone the app from GitHub and run the chat application:

git clone https://github.com/abhirockzz/langchain-valkey-chat-history
cd langchain-valkey-chat-history

go run *.go


Start a conversation — as you do that, all the conversation history will be stored in Valkey.

conversation

If you peek into Valkey, notice that the conversations are saved in a List:

valkey-cli keys *
valkey-cli LRANGE <enter list name> 0 -1


Don't runkeys * in production — its just for demo purposes.

example

Chat History Component Implementation

You can refer to the complete implementation here. The component implements the schema.ChatMessageHistory interface methods in langchaingo and uses List data structure behind the scenes. Starting the application creates a new "chat session" is associated with a List — each new instance will be backed by a separate List.

Key methods that were implemented:

  • AddMessage : Stores a conversation message, using LPUSH
  • Messages : Retrieves all the messages in a conversation using LRANGE
  • Clear : Deletes all messages in a conversation using DEL

Conclusion

It's important to note that it's possible to use any Redis-compatible client with Valkey. I used the go-redis client, but (at the time of writing) there is work underway to build Valkey-specific client libraries. Check the Valkey GitHub org to take a look at the forks of existing Redis client libraries such as valkey-go (corresponding to rueidis), iovalkey (corresponding to ioredis), Jackey (corresponding to jedis), etc. These are very early days (at the time of writing), and it will be interesting to see the progress here!

Happy building!

AI Open source application Redis (company)

Published at DZone with permission of Abhishek Gupta. See the original article here.

Opinions expressed by DZone contributors are their own.

Related

  • Deploying AI With an Event-Driven Platform
  • Redis-Based Tomcat Session Management
  • Why Use LocalPV with NVMe for Your Workload?
  • AI-Era Cybersecurity, Part 1: Mapping Glasswing, Daybreak, Lightwell and the Tools Racing to Find and Fix Bugs

Partner Resources

×

Comments

Loading comments

The comments didn't load

Please try again in a moment.

Likes

Loading

The next likes didn't load. Please try again.

The likes didn't load

Please try again in a moment.

See who liked this

Log in or join DZone for free to see who liked this article.

Log in Join for free
  • RSS
  • X
  • Facebook

ABOUT US

  • About DZone
  • Support and feedback
  • Community research

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Core Program
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 3343 Perimeter Hill Drive
  • Suite 215
  • Nashville, TN 37211
  • [email protected]

Let's be friends:

  • RSS
  • X
  • Facebook