Reviews from AWS Marketplace
0 AWS reviews
-
5 star0
-
4 star0
-
3 star0
-
2 star0
-
1 star0
External reviews
External reviews are not included in the AWS star rating for the product.
Best in class tool for experimentation
What do you like best about the product?
Clean interface, great visualizations that help demystify experiment set up and analysis. Love the color code to see impact, confidence intervals, etc. Really useful for quickly understanding the effect of a change on an ecosystem of metrics!
What do you dislike about the product?
Can take a while to set up your org if you have a LOT of metrics.
What problems is the product solving and how is that benefiting you?
We use Eppo to monitor ecosystem-level changes we make to our product. This allows us quickly iterate on any surface of the app, with greater awareness of downstream effects on metrics. I always have an Eppo tab open!
- Leave a Comment |
- Mark review as helpful
The experimentation tool you’ve been waiting for
What do you like best about the product?
- Decoupled from the backend
- Data lives in the warehouse
- Best UX of third-party tools
- Most robust statistical inference
- Can use of dbt data models for single source of truth
- CUPED for faster AB tests
- Data lives in the warehouse
- Best UX of third-party tools
- Most robust statistical inference
- Can use of dbt data models for single source of truth
- CUPED for faster AB tests
What do you dislike about the product?
The only thing we could really use would be more integration with our stack. For example, connecting with our ML deployment tools to enable native model AB testing. I believe this is coming soon though.
What problems is the product solving and how is that benefiting you?
- Running robust, fast, safe experiments at scale
- Feauture flagging SDK for peoduxt and feature roll outs and testing
- Metrics definitions for downstream analytics
- Feauture flagging SDK for peoduxt and feature roll outs and testing
- Metrics definitions for downstream analytics
Eppo is a game changer for platform reliability
What do you like best about the product?
1. Eppo makes experiment setup easy for engineers with metric collections
2. Eppo is powered off of our Snowflake Data Warehouse, making it easy to integrate complex metrics that require joins across multiple data types, or events that happen signficantly after experiment diversion.
3. Eppo made it easy to create new fact tables for diversion criteria, simplifying metric creation (we were able to key data off of both messages and tenants in minutes, something we struggled to get working with a competing product for weeks).
4. Eppo slices (split by) make it easy to investigate unexpected experiment impact or results
5. The UI is simpler and easier to understand than competing products, while also containing a more powerful feature set.
I've actively recommended Eppo to other startups and one of our VCs.
2. Eppo is powered off of our Snowflake Data Warehouse, making it easy to integrate complex metrics that require joins across multiple data types, or events that happen signficantly after experiment diversion.
3. Eppo made it easy to create new fact tables for diversion criteria, simplifying metric creation (we were able to key data off of both messages and tenants in minutes, something we struggled to get working with a competing product for weeks).
4. Eppo slices (split by) make it easy to investigate unexpected experiment impact or results
5. The UI is simpler and easier to understand than competing products, while also containing a more powerful feature set.
I've actively recommended Eppo to other startups and one of our VCs.
What do you dislike about the product?
Eppo has a few experiment measurement features we'd really like support for, and I'm sure they'll get to these soon:
1. Pre-post experiments (useful for binary rollouts, runtime environment ugprades, etc that can't be experiment flagged). We've creatively worked around this limitation for now by altering the data we feed Eppo.
2. Automatic experiment updates on flag value ramps. It would be great to see Eppo understand that an Experiment has been ramped (e.g. 10->20% diversion) and for it to automatically update the expected diversion % after that point. Eppo automatically detects variation distribution and messages in the UI that the results are no longer valid, it would be nice to have a mode where it automatically adjusted it's expected variation when it detects stable traffic variations.
1. Pre-post experiments (useful for binary rollouts, runtime environment ugprades, etc that can't be experiment flagged). We've creatively worked around this limitation for now by altering the data we feed Eppo.
2. Automatic experiment updates on flag value ramps. It would be great to see Eppo understand that an Experiment has been ramped (e.g. 10->20% diversion) and for it to automatically update the expected diversion % after that point. Eppo automatically detects variation distribution and messages in the UI that the results are no longer valid, it would be nice to have a mode where it automatically adjusted it's expected variation when it detects stable traffic variations.
What problems is the product solving and how is that benefiting you?
Eppo has enabled our team to implement an observability and change management system for our platform infrastructure. We use Eppo to measure changes across a variety of metrics in Courier's Send Pipeline (latency, volume, stage dropoff, error rates, event state, message state) in order to ensure that new changes don't negatively impact our customers. Eppo helps the engineering team observe expected rare events (3 per million messages) and zoom in on impacted slices. Eppo's sequential + CUPED experiment analysis mode gives us the confidence to roll changes out after just a 5% diversion after a few hours.
We're also using Eppo to measure lift in user interface A/B tests, helping us speed up feature adoption.
We're also using Eppo to measure lift in user interface A/B tests, helping us speed up feature adoption.
Data driven Feature management
What do you like best about the product?
Quick way to validate hypothesis and bake science while building the product that meets customer needs
What do you dislike about the product?
I wish we could embed Eppos experiments as service within our application
What problems is the product solving and how is that benefiting you?
- Experimenting when releasing new feature
- validating existing changes (feature management)
- validating existing changes (feature management)
Eppo helps ClickUp rapidly scale product experimentation
What do you like best about the product?
I love the ability to run warehouse native experimentation using Eppo, it is easy to set up experiments in Eppo up with the right data models and their statistical rigor helps us be on top of the best experimentation practices. I specifically love the ability to define warehouse native metrics and business-specific entities. I think this tool is a must-have in any experimentation team' stack
What do you dislike about the product?
The current areas of opportunity for Eppo are around providing more in-app content to non-technical audience while interpreting their results, and would love to see a more customizable notification system.
What problems is the product solving and how is that benefiting you?
- Scaling experimentation rapidly
- Reliable statistics
- Warehouse native
- Incredible support team
-
- Reliable statistics
- Warehouse native
- Incredible support team
-
Eppo makes it fun and easy to do A/B tests again! It makes it painless to be statistically rigorous
What do you like best about the product?
Without Eppo, running and analyzing A/B tests consistently (and accurately) in a company is a nightmare. Eppo makes it a breeze to set up metrics, and then handles the statistics automatically so you don't have to wrestle with it. The statistical calculations just fade into the background so you can focus on more interesting problems. Furthermore, Eppo displays the results in the most intuitive ways. It's easy to share the A/B tests with stakeholders and have them understand the outcome. You don't have to be a statistics expert to use and appreciate Eppo!
What do you dislike about the product?
I don't really have any complaints about Eppo! It requires a bit of care to set up, but once it's set up, it's fairly plug-and-play.
What problems is the product solving and how is that benefiting you?
We used to run A/B tests with multiple product teams each handling statistics "their own way" and reporting results "their own way." Often, those ways were haphazard, incorrect, and difficult to interpret. Eppo fixed all of this.
Improves decision making that leads to greater impact
What do you like best about the product?
We long suffered from training product managers on manual calculations of A/B test performance based on using traditional BI tools. Statistical significance is not the simplest concept to grasp, understand and utilize in the right ways. Confident we made wrong decisions based on miscalculating during A/Bs that were not stat sig. Eppo has unlocked our ability to standardize our decision making on A/Bs, increased our confidence in making those decisions, and has greatly increased our velocity to make decisions. That has multiple levels of value to an organization.
What do you dislike about the product?
I have not encountered a downside yet as an observer of the analysis it providers, but I am not a pure user. The ability to view performance is straight forward and the UI provides what I need for quick insights.
I'd love to see expansion into general product analytics in the future - confident the Eppo team could do better than tools like Amplitude.
I'd love to see expansion into general product analytics in the future - confident the Eppo team could do better than tools like Amplitude.
What problems is the product solving and how is that benefiting you?
Poor velocity in decision making on A/Bs, and wrong decisons made. Much more confidence gained by our team in making these decisions using this tool.
Eppo has been a game changer for our A/B Testing program!
What do you like best about the product?
Eppo saves us a ton of time creating and monitoring A/B tests. I love the feature to detect a traffic imbalance - this has saved us multiple times in situations where we had a bug in the bucketing logic. I have been really impressed with the statistical sophistication of Eppo; features like CUPED and the sample size calculator have sped up the process and reduced test durations. Overall, Eppo has reduced the time PMs spend on A/Bs by over 50% and is well-loved by folks at The Zebra. The team at Eppo is so responsive and helpful too, and I predict we will be working with them for a long time.
What do you dislike about the product?
Not many downsides, it is a fairly new product so there are sometimes minor UI bugs and frustrations, but the team is very responsive and fixes issues quickly.
What problems is the product solving and how is that benefiting you?
Eppo helps us solve the following problems:
- Monitoring running tests to catch bugs and data quality issues
- Plan tests and calculate sample size
- Quantify the impact of the test on key metrics and assess whether the impact is statistically significant
- Make A/B testing discoverable so any team member can understand how an A/B is performing
- Saving analyst time on manual reporting and calculating sample size
- Monitoring running tests to catch bugs and data quality issues
- Plan tests and calculate sample size
- Quantify the impact of the test on key metrics and assess whether the impact is statistically significant
- Make A/B testing discoverable so any team member can understand how an A/B is performing
- Saving analyst time on manual reporting and calculating sample size
A tool that ensures we're making better business decisions
What do you like best about the product?
Eppo has enabled our business to make more sound decisions about our A/Bs, with its easy-to-read results page.
The sample size calculator has also greatly simplified the way we estimate how long a test takes and made me feel more confident sharing that with stakeholders.
Their response team has also been outstanding; any issues that we find are caught and handled quickly, and they've helped us all level up in our understanding of statistics.
The sample size calculator has also greatly simplified the way we estimate how long a test takes and made me feel more confident sharing that with stakeholders.
Their response team has also been outstanding; any issues that we find are caught and handled quickly, and they've helped us all level up in our understanding of statistics.
What do you dislike about the product?
If you are not a stats-oriented person, the results page can seem overwhelming.
What problems is the product solving and how is that benefiting you?
We previously were analyzing A/B tests with a shotty statistical significance measure, so I often felt uncertain about the output of our tests, but not anymore!
Eppo also has the benefit of sitting on top of our existing data, which means less work for our development team and a clearer view of performance across all our reporting tools.
Eppo also has the benefit of sitting on top of our existing data, which means less work for our development team and a clearer view of performance across all our reporting tools.
Excellent tool to manage resources efficiently.
What do you like best about the product?
It functions similarly to an LDAP server, managing all users, roles, and permissions and acting as a role definer. It contains a metadata store that allows for the establishment of roles and users. This is quite handy for managing and regulating huge numbers of definitions. One of the most important factors is having the correct repository and being willing to schedule jobs. Eppo provides us with server access, resource access limits, and the ability to manage metadata items via numerous tabs.
What do you dislike about the product?
To utilize this technology, resources must have appropriate data management capabilities. One of the issues I have with Eppo is that data produced on it cannot be accessible by other programs. Other from that, there isn't much to dislike because it is highly informative and adequate instructions are also accessible. Nonetheless, if you have to select something, the Interface may benefit from a refresh.
What problems is the product solving and how is that benefiting you?
Eppo is quite useful for managing server and library definitions. Recent update additions, such as grid settings and server control options, are particularly handy for day-to-day use. It has aided in the development of appropriate user processes. The distribution of rights, who can view what, and all of this information can be simply exported. The import and export operations are quite useful, as are the categorization and data classification summary functions, which are the most commonly utilized and aid in data management.
showing 21 - 30