Within your course repository, create a directory "hw3". Commit and push to your remote repository.

cd <path_to_repo>
mkdir hw3
touch hw3/screencast_url.txt
git add hw3
git commit -m "initial commit for hw3"
git push

In this homework, you will analyze the security of the LangChain RAG application and LangChain agent that you have written in the previous two assignments.

As the RAG application has been loaded with documents from many sources, test your application to see how it may be vulnerable to:

As the agent has been given access to the Terminal tool, test your application to see how it may be vulnerable to:

Based on the vulnerabilities described in class, show how the execution of your applications can be compromised in ways you initially did not intend or expect.

Screencast

Upon completing your analysis, via a narrated screencast of no longer than 5 minutes, go through your findings and demonstrate the problematic executions of your applications. Ensure that it is published as "Unlisted". Then, update the file screencast_url.txt in the homework's directory to contain the URL that your unlisted screencast on MediaSpace is located. Push the changes that include the updated URL to your repository before class.

Rubric

We will be using your screencast to evaluate your homework.

Demonstration of attacks on agent

Number of attack vectors tested

Coverage of range of adversarial attack types