Spaces:
Runtime error
Runtime error
File size: 4,195 Bytes
d070a30 766d70c d070a30 0b80008 d9b1bf6 d070a30 d9b1bf6 d070a30 cc93c45 d070a30 0b80008 cc93c45 0b80008 cc93c45 0b80008 ff20e95 8b67ee1 cc93c45 0b80008 cc93c45 0b80008 98f8462 0b80008 cc93c45 98f8462 0b80008 a9d1347 cc93c45 0b80008 cc93c45 0b80008 cc93c45 0b80008 cc93c45 a9d1347 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 |
---
title: Arxiv Plagiarism Checker LLM
emoji: 🚀
colorFrom: pink
colorTo: pink
sdk: docker
app_port: 7860
pinned: true
---
# Arxiv Plagiarism Checker LLM
**Demo** - [Link](https://huggingface.co/spaces/asach/arxiv-plagiarism-checker-Ilm)
**Dataset** - [Link](https://huggingface.co/datasets/asach/arxiv-2023-4-months-openai-embeddings)
[](https://github.com/gamingflexer/arxiv-plagiarism-checker-llm/actions/workflows/main.yml)
Arxiv author's plagiarism check just by entering the arxiv author
## Docs & Working
INPUT - Authors Name
OUTPUT - Plagiarism Check Results
You can get MIT authors List from here - [Link](https://dspace.mit.edu/handle/1721.1/7582/browse?rpp=100&sort_by=-1&type=author&offset=100&etal=-1&order=ASC)
## Dataset & Embeddings
We have used the arxiv dataset for the year 2023 & 2024 and then we have used the OpenAI Embeddings to generate the embeddings for the documents.
- Install gsutil - [Link](https://cloud.google.com/storage/docs/gsutil_install)
```bash
# Single year files
gsutil cp gs://arxiv-dataset/arxiv/arxiv/pdf/19*/ ./papers_from_2019/
#single file
gsutil cp gs://arxiv-dataset/arxiv/arxiv/pdf/2310/2310.00001v1.pdf .
```
### Tech Stack
- Gradio
- ChromaDB
- SERP API
- OpenAI GPT Embeddings & LLM Models
1. We have collected the data from arxiv GCP cloud for the year of 2023 & 2024 and then we have used the text-embedding-3-large to generate the embeddings for the documents. This amount to about 10GB.
2. Document Text Extraction is done in 2 formats with metdata
- Document Level
- Paragraph Level
- MetaData
Meta data example
```json
{
"id": "2106.09680",
"title": "Accuracy, Interpretability, and Differential Privacy via Explainable Boosting",
"summary": "We show that adding differential privacy to Explainable Boosting Machines\n(EBMs), a recent method for training interpretable ML models, yields\nstate-of-the-art accuracy while protecting privacy. Our experiments on multiple\nclassification and regression datasets show that DP-EBM models suffer\nsurprisingly little accuracy loss even with strong differential privacy\nguarantees. In addition to high accuracy, two other benefits of applying DP to\nEBMs are: a) trained models provide exact global and local interpretability,\nwhich is often important in settings where differential privacy is needed; and\nb) the models can be edited after training without loss of privacy to correct\nerrors which DP noise may have introduced.",
"source": "http://arxiv.org/pdf/2106.09680",
"authors": "Harsha Nori Rich Caruana Zhiqi Bu Judy Hanwen Shen Janardhan Kulkarni",
"references": ""
}
```
3. Embeddings are generated for the documents and paragraphs using OpenAI Models
4. Authors are then searched on the Google SERP API and the documents (Top 10) are then compared individually with the embeddings of the documents.
5. Retreived documents & Top 3 simialar papers from Google SERP API on the topic
- Metadata and text is extracted
6. Once Extracted Unique Lines and Paragraphs are extracted and then compared by using LLM - GPT 4 Preview Model - 128K
7. Unique Lines are then compared with the document embeddings and the paragraphs are compared with the paragraph embeddings.
8. Top 3 Similar Text and respective documents are then returned to the user as Plagiarised Content.
### Research Points
- Miro RoadMap [Link](https://miro.com/app/board/uXjVN8HgXk8=/)
- Notion [Link](https://gamingflexer.notion.site/Arxiv-983d173f46c1426caa9dab319f4ddb3d?pvs=4)
### Top Plagiarism Checkers API
- **[ProWritingAid API V2](https://cloud.prowritingaid.com/analysis/swagger/ui/index) - Free Plan**
- **[Unicheck](https://unicheck.com/plagiarism-checker-api) - Request Demo**
- **[Copyleaks]() - Request Demo**
- **[EDEN AI](https://www.edenai.co/feature/plagiarism-detection) - Free Plan**
----
## Requirements
- Python 3.9+
- Gradio
- GPT Keys
## Installation
```bash
pip install -r requirements.txt
```
## Usage
We are using a gradio app to implement the plagiarism checker
```python
python app.py or gradio app.py
``` |