Listing Thumbnail

    Deepchecks LLM Evaluation

     Info
    Sold by: Deepchecks 
    Deepchecks is an AI evaluation platform, for evaluating LLM-based applications during research, ci/cd and production. Deepchecks' robust automatic scoring, version comparison, and auto-calculated metrics (such as relevance and grounded in context) enables AI teams to efficiently detect, troubleshoot, and improve their application's performance.
    Listing Thumbnail

    Deepchecks LLM Evaluation

     Info
    Sold by: Deepchecks 

    Overview

    Deepchecks enables AI application developers and stakeholders to continuously validate LLM-based applications including characteristics, performance metrics, and potential pitfalls throughout the entire lifecycle from pre-deployment and internal experimentation to production.

    Using the built-in and customizable properties, robust automatic scoring, version comparison, root cause analysis and production monitoring capabilities of Deepchecks, AI teams can achieve a comprehensive understanding of the application's performance, troubleshoot and improve it.

    Highlights

    • Ensure good application performance, thanks to Deepchecks' robust automatic scoring, and replace hours of manual labor with a single click
    • Multiple built-in and customizable properties, for efficient troubleshooting and comparison, from research, deployment and to production monitoring
    • Integrate your application in minutes by adding 3 lines of code and have your LLM based applications' performance efficiently analyzed

    Details

    Delivery method

    Features and programs

    Financing for AWS Marketplace purchases

    AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
    Financing for AWS Marketplace purchases

    Pricing

    Deepchecks LLM Evaluation

     Info
    Pricing is based on contract duration. You pay upfront or in installments according to your contract terms with the vendor. This entitles you to a specified quantity of use for the contract duration. Usage-based pricing is in effect for any usage exceeds the entitle amount or not covered in the contract. These charges will be applied on top of the contract price. If you choose not to renew or replace your contract before it ends, access to your entitlements will expire.

    12-month contract (1)

     Info
    Dimension
    Description
    Cost/12 months
    Deepchecks Subscription
    Deepchecks License. Up to 20M Tokens uploaded, and 40M Tokens processed by LLM properties, per month. Up to 10 applications, and 5 Users.
    $30,000.00

    Additional usage costs (2)

     Info

    The following dimensions are not included in the contract terms, which will be charged based on your usage.

    Dimension
    Description
    Cost/unit
    Tokens Uploaded Monthly
    Additional Tokens uploaded monthly (price per million tokens)
    $25.00
    LLM Properties Processed Monthly
    Additional Tokens for processed llm properties (price per million tokens)
    $3.00

    Vendor refund policy

    Legal

    Vendor terms and conditions

    Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .

    Content disclaimer

    Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

    Usage information

     Info

    Delivery details

    Software as a Service (SaaS)

    SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.

    Resources

    Support

    AWS infrastructure support

    AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.

    Similar products

    Customer reviews

    Ratings and reviews

     Info
    0 ratings
    5 star
    4 star
    3 star
    2 star
    1 star
    0%
    0%
    0%
    0%
    0%
    0 AWS reviews
    |
    19 external reviews
    External reviews are sourced from G2  and are not included in the star rating for this product.
    Almog B.

    Great Platform for Cross-Functional Teams

    Reviewed on Oct 28, 2024
    Review provided by G2
    What do you like best about the product?
    The best part of Deepchecks is how well it supports both technical users like data scientists and non-technical users like product managers.

    Also, I found their support professional, fun to interact with, and very helpful.
    What do you dislike about the product?
    I haven't run into anything negative yet.
    What problems is the product solving and how is that benefiting you?
    It makes collaboration much easier across our team. The platform’s ability to detect hallucinations in LLM outputs is crucial for maintaining model integrity.
    Daniel T.

    Awesome for LLM tasks

    Reviewed on Oct 24, 2024
    Review provided by G2
    What do you like best about the product?
    They are great at providing a flexible solution for avariousLLM tasks, including especially summarization. The platform is user-friendly for technical and business users, making adoption across teams much easier. I also appreciate the range of deployment options available, which help meet our strict privacy standards.
    What do you dislike about the product?
    I haven't found anything yet so far, it's pretty great overall
    What problems is the product solving and how is that benefiting you?
    It's basically helping with all types of LLM evaluation that require a lot of time.
    Eyal C.

    Exceptional Platform for LLM and Tabular Data Evaluation

    Reviewed on Oct 10, 2024
    Review provided by G2
    What do you like best about the product?
    Deepchecks is an all-in-one solution for both LLM and tabular data. It excels at detecting hallucinations and irrelevant answers, providing unparalleled support for various tasks like summarization, text2SQL, code generation, and more. I also appreciate how it caters to both technical users (data scientists, developers) and non-technical users (product managers). Their compliance with strict data privacy standards is a huge plus for our deployment.
    What do you dislike about the product?
    Nothing negative so far. I’m still exploring it, but the experience has been top-notch.
    What problems is the product solving and how is that benefiting you?
    Reduce time to value
    Computer & Network Security

    Best Solution for Both Coders and Clickers

    Reviewed on Oct 06, 2024
    Review provided by G2
    What do you like best about the product?
    Deepchecks offers an excellent user experience for both coders like data scientists and developers, as well as clickers like product managers. I love how intuitive it is for different types of users. Its ability to handle various tasks, from Q&A chatbots to summarization and text2SQL, is fantastic. The compliance with data privacy rules also makes it ideal for our enterprise needs.
    What do you dislike about the product?
    I haven’t found any issues yet, but I'm hoping customer service continues to be as excellent as the platform.
    What problems is the product solving and how is that benefiting you?
    It offers an excellent user experience for both coders like data scientists and developers, as well as clickers like product managers. I love how intuitive it is for different types of users. Its ability to handle various tasks, from Q&A chatbots to summarization and text2SQL, is fantastic. The compliance with data privacy rules also makes it ideal for our enterprise needs.
    Telecommunications

    Deepcheck a validating tool for machine learning

    Reviewed on Sep 11, 2024
    Review provided by G2
    What do you like best about the product?
    Best thing is its open source plateform which makes it cost effective and easily accessable for validating AI and ML related things
    What do you dislike about the product?
    Its often seen open source plateforms are not as secured as paid one so feature and security wise it can have some problem
    What problems is the product solving and how is that benefiting you?
    Its helping in data validation
    View all reviews