Buying Software With AI Assistance

A Comprehensive Guide

Software Shopping With AI As Your Assistant

Selecting enterprise software for your team is a challenging exercise. Making the right decision solves problems, reduces company risk, and has your team sending celebration memes over Slack. Making the wrong decision not only doesn’t solve problems, it can create new problems, increase the risk of the company achieving its goals, stress people out, and negatively impact your career.

Artificial intelligence (AI) is increasingly integrated into both workplace and daily life tasks. In the workplace, employees rely on AI to accomplish substantial objectives—such as researching topics, assisting with content creation, and contributing to strategic planning. AI is also a valuable tool for shopping for software solutions within a business. The process outlined below—including suggested prompts—can help any organization identify the best enterprise software choice for its needs, whether seeking PLM, QMS, MES, ERP, CRM, or other solutions.

Image-microchip with brain icon centered on dark circuit board

4 Steps to Get AI Assistants Busy Shopping for Your Next Solution

1. Select an AI suited to your task

a. Choose the right AI.
Not all AIs are equal, and many are designed for specific use cases, from finding the perfect restaurant for an offsite to developing revolutionary eco-friendly waterproof coatings. There are many types of AI (and it can get esoteric to try to agree on the number and divisions). Even within a category of AI, different AI offerings use different large language models (LLMs) with varying constraints and reach. You may use Midjourney or Canva if you need cosmic squirrel art or new LinkedIn banner images. Grammarly’s powerful AI features are great for getting your first novel out of your brain and to the finish line. StyleAI might help you with that special outfit for your cousin’s wedding.

For enterprise software shopping, you need a research-oriented AI that can perform web searches for the most up-to-date information possible.

Use an AI with a “research” mode turned on to make sure it is double-checking its work and providing sources for all facts that you can double-check and explore. It may take a while to generate output, but the quality will dramatically improve. Remember that cloud-based enterprise software like Arena continuously releases new features and updates. Using an AI with stale data may give you inaccurate information and should not be trusted. We’ve provided some AI recommendations in the table below based on our testing to get you started. You can also use AI to help you find new AI research tools.

b. Explore your AI’s settings.
Start by asking your AI if it has special settings or access to private data. Some AIs, like Microsoft 365 Copilot and Claude, may have access to special settings that are designed for your specific use case. Your AI may also have access to your company’s internal documents and communications, which can help it tailor its findings to your specific needs.

2. Prompt the AI

a. Requirements are, well, still required.
Before you can construct a good prompt, you need to identify business needs and capture your requirements. What your team needs is not identical to what other teams need. AI will provide generic non-actionable results if you don’t provide the context of your business needs and requirements. If you aren’t entirely sure if your requirement list is complete or accurate, consider also using AI to help review it. You can refer to our How to Buy Software Guide on the process of building a team and doing this work if you aren’t sure where to start.

b. Good input = better output.
Prompt engineering is a skill, and every AI has its own personalities and peculiarities. Getting one AI to generate useful information may require a very different prompt from another. Some may work best with a detailed, lengthy prompt while others generate more useful answers from shorter, general questions. Others are sycophantic and work best when you tell them to act as devil’s advocate. However, you don’t have to have a degree in machine learning or AI to construct a good prompt. You do need an understanding of what a good prompt is, an iterative experience, and the willingness in the community to share good prompts. And, we are a sharing people at Arena by PTC, so use these starter prompts and go from there.

c. Try multiple AI!
In our experiments, the results can vary dramatically. Go wild and try several. If this is your first time using AI for a structured research project, running the prompt through multiple will help you see the differences between tools and give you better overall content to use in your search.

3. Interpret the AI results

a. AI is fallible and AI hallucinates.
Hallucinations are when our sensory perception does not correspond to the external stimuli. AI hallucinations occur when the algorithmic system gives information that seems plausible but is false, inaccurate, or misleading. (Dive deeper into this topic with researchers here.) This is particularly true when asking questions about enterprise software, for which publicly available documentation is often unavailable. You can mitigate this issue by turning on “Research mode,” but even this is not a guarantee. Software selection is important to your company and, therefore, to you and your team. AI hallucinations can cause real damage to yourself, your colleagues, and your business when used unchecked. If something sounds too good to be true, make sure to verify by reviewing the AI’s sources. See step 4 for more recommendations on how to mitigate this risk.

b. Iterate with the AI to improve the results.
Ask follow-up questions to dig deeper into a topic or have the AI consider the issue from a different perspective. You can have conversations with the AI to improve the results (until you run out of credits if using a free or limited version of the tool). You may also find that the AI’s clarifying questions or results give you improvements to the initial prompt that you want to re-run or run in another tool.

AI is subject to the data it consumes and that data’s intent.

Software vendors do not publish everything about their companies, product roadmaps, functionality, and customer commitments. As AI-powered search and research tools have gained dominance and are fast replacing traditional web searches, all companies are now working to rapidly catch up to the new AEO (answer engine optimization) that is replacing traditional SEO (search engine optimization). What does this mean? All of us—including your own company—are busy re-evaluating the content breadth, depth, and structure on our public sites and other locations.

4. Engage people to continue the selection process

a. Don’t abdicate to AI.
Humans need to be in the loop at every step—from identifying business needs and requirements to running well-executed AI research to giving vendors the chance to respond to what you have learned so far in your research—answering your questions, providing customer references, and all the other critical information you need to make a great decision. Additionally, you may have a very detailed requirements list with weightings and other roll-up considerations. Generic AI research tools often lack access to the proprietary or nonpublic data needed to fully understand your requirements. As a result, they may misinterpret what you’ve uploaded or fail to assess whether a specific vendor can meet your needs. Just like working with a colleague, asking the AI to rephrase your requirements in its own words can help surface misunderstandings and clarify intent.

b. Help vendors help you.
Vendors can better respond to your search when you are transparent about your business needs and requirements. And, if you have used AI tools for research, let the vendors know and ask them to respond to the results and prove out solutions.

Image- Engineers collaborating,  analyzing data using laptop computer in a R&D setting

Reviewed AI Research Tools

To get you started, we tried some current popular AI research tools. We tested them with the prompts we are providing here for enterprise software shopping with a few composite company use cases. Everything in AI is changing rapidly. We expect your experience will vary from ours, depending on what tools you use, the prompt changes you make, when you make your calls, and your specific use case. By sharing our experiences, we hope to illustrate the variances you might see across AI tools, encourage you to experiment, but also always ensure humans are in control. For our tests, we successfully ran the prompts using free versions of these platforms (except Microsoft 365 Copilot Researcher, where we used our corporate domain license).

Logo-Claude Ai

Claude Sonnet 4.0

Pros

  • Best clarifying questions before executing the task
  • Provides a high-level summary and then extended response in well-structured format
  • Provides a scoring matrix and results, along with its reasoning

Cons

  • In the free version, you can run out of daily credits if you iterate on the prompt results without moving to another AI chat

Fine-Tune

None

Logo-ChatGPT

ChatGPT

Pros

  • Clarifying questions before completing task

Cons

  • Not particularly “deep” research. Sources consist mostly of vendor websites or vendor-written articles on content sites
  • Does not consider the longevity of data and provides information on solutions no longer sold or available

Fine-Tune

Deep research mode

Logo-Microsoft 365 Copilot

Microsoft 365 Copilot

Pros

  • Deep analysis of the solution options, including considerations not specified in the prompt
  • Provides a high-level summary and then extended response in well-structured format

Cons

  • Clarifying questions can try to limit scope to a list you want to consider
  • Can ignore the specific requirements or constraints provided in the prompt.
  • Will not provide ranking or recommendation comments unless prompted to do so

Fine-Tune

Use Researcher agent if available

Logo-Google Gemini

Google Gemini

Pros

  • Will provide a research plan for Gemini to undertake and prompt user for modifications
  • Very educative: best at showing its work, and in results, providing user with a summary of the topic itself

Cons

  • Did not ask any clarifying questions before executing the task
  • Has tendency to provide incomplete thoughts/sentences
  • Will not provide ranking or recommendation comments unless prompted to do so

Fine-Tune

Deep Research option

Image-internet of things, abstract futuristic cyber network

Let’s Get Started: Prompts

Instructions for Use

Step 1: Fill in the Industry/Domain and Organization Context sections with your specific details.

Step 2: Provide as much detail as possible in the Specific Needs & Examples section.

Step 3: Submit this information and be prepared to answer follow-up clarifying questions if the AI asks.

Step 4: Review the structured analysis for each recommended solution.

Step 5: Ask the AI to refine results based on your review. You may notice sections where you have failed to provide guidance on requirements, business needs, or constraints. You may want the AI to summarize the research. You can continue to refine the results (you may run out of daily credits, though).

Copy these prompts to a document and then complete the sections for your needs. Always save your prompts. Then copy and paste the prompt into the AI tool of your choice. Note: Some AI tools don’t support copy and paste of text (Gemini, currently). You can upload the saved prompt document instead.

Prompt 1: All-in-One Prompt to Identify Possible Solutions

Prompt Use Case:

You are an expert enterprise software consultant helping a team select the optimal software solution for their organization. Your role is to guide them through a comprehensive evaluation process. You should provide pros and cons. You should ask clarifying questions as needed. You should provide clear next steps and a decision framework. Provide potential challenges and risk mitigation strategies. Include sources.

Tone:

Objective, analytical, and professional.

Task:

You should cover the following in the comparison:
[Edit this list if you have specifics or consider splitting the list into high priority and lower priority]

  • Features
  • Costs for software
  • Costs for services
  • Implementation times
  • Success with the software
  • Scalability
  • Integration and extension strategy and capabilities
  • Customer base, success, stories

Team Scenario:

Here are the details on needs.

Industry/Domain:

[Provide the type of software you are looking for. E.g., CRM, ERP, PLM, HR management, project management, marketing automation, etc.]

Organization Context:

  • Company size (employees, revenue range)
  • Industry sector
  • Current technology stack
  • Geographic presence
  • Annual subscription budget for this software
  • Implementation services budget for this software

Specific Needs & Examples:

  • Primary business problems we are trying to solve
  • Must-have features
  • Nice-to-have features
  • Current pain points with existing solutions
  • Success metrics we want to achieve
  • Specific use cases or workflows the software must support

Prompt 2: Prompt to Evaluate a Vendor From a Corporate Stability, Financials, and Risk Perspective

With this prompt, there is an option to upload to the AI documents provided by a vendor (e.g., corporate financial reports, customer story deck, detailed third-party reviews). The prompt directs the AI to consider these if provided. If not, the AI is directed to utilize public domain data it can access.

Note: This prompt can be run against a vendor and then re-run against a second. Some AI tools will automatically compare the two vendors in the second response if done in the same session. Alternatively, you could expand the prompt to analyze multiple vendors and provide a comparison.

Image-Person interacting with a checklist on laptop screen

Prompt Use Case:

You are a business decision-maker, evaluating potential enterprise software vendors. Include sources.

Tone:

Objective, analytical, and professional.

Task:

Conduct a comprehensive review of the provided information about [Vendor Name], focusing on financials, business performance, and customer base to assess viability as a long-term partner.

Context:

[Describe your industry, e.g., large manufacturing company, midsize financial services firm] is evaluating [Vendor Name] for [Describe the software need, e.g., a new ERP system, a cloud-based CRM solution].

Key priorities are:

  • Vendor stability
  • Proven experience with enterprise clients
  • A strong track record of product development and customer satisfaction

Input:

Search for publicly available data and analyze the following information. Include the data I have provided in the upload, if any.

  • Financial documents: [e.g., annual reports for the last three to five years, investor presentations, credit reports]
  • Business performance data: [e.g., SaaS KPIs like ARR, churn rate, LTV/CAC ratio, R&D spending percentage, product development roadmap]
  • Customer base information: [e.g., number of enterprise clients, breakdown of customer size and industry, customer retention rate, Net Promoter Score (NPS), customer references/case studies]
  • Industry analyst reports: [e.g., Gartner Magic Quadrant reports, Forrester Wave reports]
  • Customer reviews/testimonials: [e.g., from platforms like G2, Capterra, TrustRadius, or the vendor’s website]

Specific Evaluation Areas:

  1. Financial Health:
    • Assess revenue trends (growth, stability, profitability) and any potential red flags like excessive borrowing.
    • Review R&D expenditure to gauge commitment to innovation.
    • Evaluate the pricing structure, including potential additional costs or license fees, and ensure alignment with long-term needs and budget.
  2. Business Performance:
    • Analyze key SaaS metrics like churn rate, customer lifetime value (CLV), and customer acquisition cost (CAC).
    • Examine the product roadmap and frequency of new releases to determine agility and adaptability.
    • Assess the ability to scale software to support anticipated growth.
  3. Customer Base and Satisfaction:
    • Verify experience with enterprise-level clients, especially those in the industry.
    • Evaluate customer retention rate and Net Promoter Score (NPS) to understand customer satisfaction and loyalty.
    • Review customer testimonials and case studies to understand the track record of success with similar companies.

Output Format:

Provide a structured report that includes:

  • A summary of key findings and recommendations
  • A detailed analysis of each evaluation area (Financial Health, Business Performance, Customer Base, and Satisfaction) with supporting evidence from the provided input
  • A risk assessment highlighting any potential concerns identified during the review
  • An assessment of whether the company aligns with priorities for vendor stability, proven experience with enterprise clients, and a strong track record