I started this experiment skeptically. My background is research-intensive writing where getting a fact wrong has professional consequences. After three months and five tools, my relationship with AI research assistance is more nuanced than either this is transformative or this is dangerous.
The Five Tools I Tested
Perplexity AI Pro for general background research. Claude Pro with document uploads for processing specific research materials. ChatGPT Plus with Browse for current information. Elicit for academic paper research and synthesis. Connected Papers for literature mapping.
The Result That Surprised Me Most: Perplexity AI
I expected Perplexity to be useful but limited. It was significantly better than expected for building initial background understanding on unfamiliar topics. For a research piece on a field I knew nothing about, Perplexity produced a sourced structured overview in about eight minutes that gave me the conceptual foundation to ask informed questions of domain experts. Time saving compared to my usual manual process: approximately three hours down to twenty minutes.
The Problem That Nearly Derailed My Work
I asked ChatGPT to help me find academic sources supporting a specific claim. It gave me four citations that looked completely real. I almost included them in a draft sent to an editor. A random spot-check revealed that one of the four citations was completely fabricated. The journal was real. The author existed. The specific paper did not exist. This experience crystallised my approach: AI tools are invaluable for understanding and synthesis. They are unreliable for specific citation generation. Every citation from an AI tool requires independent verification before use in any professional context.
| Tool | Best Use | Fact Accuracy | Citation Safety | Time Savings |
|---|---|---|---|---|
| Perplexity AI Pro | Background research sourced overviews | High | High live sourcing | Very High |
| Claude plus documents | Processing specific research materials | Very High | High stays in documents | Very High |
| ChatGPT plus Browse | Current developments news research | Moderate | LOW verify all citations | High |
| Elicit | Academic paper search and synthesis | High | High real papers only | High |
| Connected Papers | Literature mapping related works | Very High | Very High real papers only | Moderate |

