Reviews from AWS Marketplace
0 AWS reviews
-
5 star0
-
4 star0
-
3 star0
-
2 star0
-
1 star0
External reviews
External reviews are not included in the AWS star rating for the product.
Prefect? More Like Perfect for our ETL Needs
What do you like best about the product?
I've been around the ETL block a few times, played with plenty of orchestration tools, and let's just say... not all of them made the cut. But Prefect? Game changer.
Why I’m seriously digging Prefect:
Keep it Simple: While some tools feel like you need a Ph.D. to figure out, Prefect is refreshingly straightforward. Setting it up? Smooth. Integrating it? Seamless.
Pure Python Love: Being Python-native feels like Prefect was made for us. Those decorators? It’s like writing poetry, but the kind that transforms data.
Crisp & Clean: The modern approach of Prefect ensures you’re not dealing with messy, convoluted code. Every line feels intentional and easy to follow.
To wrap it up, if you’re in the ETL world and haven’t given Prefect a shot, I'd say it’s high time you do.
Why I’m seriously digging Prefect:
Keep it Simple: While some tools feel like you need a Ph.D. to figure out, Prefect is refreshingly straightforward. Setting it up? Smooth. Integrating it? Seamless.
Pure Python Love: Being Python-native feels like Prefect was made for us. Those decorators? It’s like writing poetry, but the kind that transforms data.
Crisp & Clean: The modern approach of Prefect ensures you’re not dealing with messy, convoluted code. Every line feels intentional and easy to follow.
To wrap it up, if you’re in the ETL world and haven’t given Prefect a shot, I'd say it’s high time you do.
What do you dislike about the product?
While Prefect might present an initial challenge to some users, its overall capabilities, modern approach, and efficiency make it a tool worthy of consideration and integration.
What problems is the product solving and how is that benefiting you?
Complex ETL Workflow Management, Error Handling and Monitoring &Scalability and Parallelism
- Leave a Comment |
- Mark review as helpful
Power in the workflow
What do you like best about the product?
Using Prefect has transformed my workflow management. Its hybrid execution model offers unparalleled flexibility, allowing local or distributed system runs. I particularly appreciate the dynamic pipeline construction, which adjusts based on intermediate results. The rich state system provides an insightful view of task execution, and the native Python API integrates seamlessly with my existing stack. Moreover, the UI dashboard, Prefect Cloud, is a game-changer for monitoring and visualizing flow runs. With its robust features and active open-source community, Prefect is an essential tool in my data toolkit.
What do you dislike about the product?
Setting up flows on the cloud felt intricate, and mastering the visualization tools in Prefect Cloud took time. Occasionally, its vast features were overwhelming, and the dynamic pipelines, though innovative, sometimes added complexity.
What problems is the product solving and how is that benefiting you?
Using Prefect has simplified my workflow management immensely. Before, I wrestled with fragmented scripts and manual tasks; now, I can easily automate complex processes. Its adaptability lets me run tasks either locally or in the cloud, fitting my varying needs. Plus, the dashboard offers a clear view of my workflows, ensuring I'm informed and in control. With Prefect, I spend less time troubleshooting and more time focusing on what truly matters in my projects.
Fast and easy to implement with short learning curve
What do you like best about the product?
Easy to implement and excellent UI to control flows & deployments
What do you dislike about the product?
Not really an issue anymore but the used to develop so rapidly that maintaining Prefect deployments was a bit pain. Keep it up and don't change base setup too often.
Currently missing: agent status alarms, more automation tasks (eg. if this then that) and if a flow jams then the agent jams/drops which is far from ideal - would need a Linux like run-one (eg. */20 * * * * * run-one python /script/to/run/awesome.py)
Currently missing: agent status alarms, more automation tasks (eg. if this then that) and if a flow jams then the agent jams/drops which is far from ideal - would need a Linux like run-one (eg. */20 * * * * * run-one python /script/to/run/awesome.py)
What problems is the product solving and how is that benefiting you?
Easy to see flow runs and possible issues. Moved over from Airflow as it seems more robust
Orchestrate your data flows perfect through perfect. !!
What do you like best about the product?
Prefect is new aged orchestration tool, designed for cloud databases. At core, it is based on python which makes it very flexible, stable, cost efficent tool to orchestrate your data pipelines. WIth prefect open source, you can literlly do magic to your data pipelines at no cost.
It helps to build resilient data pipeines by running the flows on flexible infrastrucure like local process, docker, kubernets, AWS, Azure containers etc. Your prefect code stays within your organization only flow runs metadata pushed to intuitive prefect UI to gain better control and visibility on your data pipeline execution. With prefect, you can build scalable, automated and resilient pipelines using features of logs rention, concurrency retries and RBAC based execution.
It helps to build resilient data pipeines by running the flows on flexible infrastrucure like local process, docker, kubernets, AWS, Azure containers etc. Your prefect code stays within your organization only flow runs metadata pushed to intuitive prefect UI to gain better control and visibility on your data pipeline execution. With prefect, you can build scalable, automated and resilient pipelines using features of logs rention, concurrency retries and RBAC based execution.
What do you dislike about the product?
Sometime felts short of examples/demo code while referring prefect documenation but I hope that will improve over time. There is no downside as in using prefect if you have python expertise on your side.
What problems is the product solving and how is that benefiting you?
Prefect blends with other ELT tool such as DBT and have dedicated python libraries which can be used to orchestrate dbt pipelines.
With prefect, we can scale, automate the deployment code for various business data mart pipelines.
Prefect allows to divide big pipelines into different task and run them either in serial or parallel as per requirement. These task then can be grouped into flows to represent one single unit of workflow. Subflow can also be used within flows if pipelines are big and complex to simlpy business logic.
With prefect, we can scale, automate the deployment code for various business data mart pipelines.
Prefect allows to divide big pipelines into different task and run them either in serial or parallel as per requirement. These task then can be grouped into flows to represent one single unit of workflow. Subflow can also be used within flows if pipelines are big and complex to simlpy business logic.
Dead simple orchestration with python
What do you like best about the product?
I have used a variety of orchestrators in the past (such as Luigi, Airflow and prefect 1) and I wasn't really satisfied with any of them. When I tried prefect 2.0 I inmediatelly felt in love with it and now I'm using it as my default orchestrator on my personal projects and I'm in process of bringing it to the company I work for. What I enjoy the most it's that you only need a decorator for defining a task and another one for defining a pipeline (called flow) and you don't need extra services or complexity to have a pipeline running. Also it's extremly less verbose than Airflow.
What do you dislike about the product?
The only major problem I see with prefect is that it's still very new and that could come at the expense of having less support and development compared to other orchestrators. However I'm willing to take the risk since I really like it.
What problems is the product solving and how is that benefiting you?
I'm trying to automate data engineering pipelines with a simple solution and Prefect is the best fit for it.
Prefect is really intuitive for engineers!
What do you like best about the product?
I like that we can easily visualise the flows and track how our jobs are being done.
What do you dislike about the product?
Probably the fact that I'm unable to see in depth on how the code flow runs as an engineer, but it could be because that I'm not aware of such feature so or it wasn't obvious enough to me.
What problems is the product solving and how is that benefiting you?
It helps us to send our tasks from backend to work asynchronously on Prefect so that we can easily streamline our processes for our business logic. As a result, it helps makes our backend more performant.
Intuitive and Feature-rich Workflow Orchestrator
What do you like best about the product?
Easy to quickly get started
Frequent release of new features
Dashboard provides extensive oversight and monitoring features
Frequent release of new features
Dashboard provides extensive oversight and monitoring features
What do you dislike about the product?
Documentation can be unclear for new features and some integrations could benefit from more examples
What problems is the product solving and how is that benefiting you?
Prefect makes it easy for me to deploy and manage my workflows with minimal administrative overhead
Prefect is a great orchestration tool that works great with dbt core for Analytics Engineering
What do you like best about the product?
It works. It's simple. It's code based and works great with dbt and git/github.
What do you dislike about the product?
Would be nice to have something more out of the box for handling concurrency.
What problems is the product solving and how is that benefiting you?
Prefect helps us orchestrate our data models that we build via dbt/Redshift and visualize with Sigma.
Great product come with great support
What do you like best about the product?
First of all, the speed of delivery by the Prefect team is simply amazing. They are always looking into improving the development and deployment aspects of the product. There is strong support through the Slack channel. I do like the rubber duck session to talk to the Prefect team members face-to-face'.
Please keep up the great work so far!
Please keep up the great work so far!
What do you dislike about the product?
On the flip side, due to the speed of the delivery of new features, it does require the end user of the product to closely follow the current state of the product in order to keep up with the latest. This is very necessary to avoid accumulating more tech debt. Just keep this in mind if you are part of a smaller orgnization.
What problems is the product solving and how is that benefiting you?
It makes easier to manage workflow and wire things together. Because of the usage of python as the language, it is also easier for us to apply good programming practice compared to other ETL tool we are using.
Extremely customizable and responsive support / community outreach staff.
What do you like best about the product?
The documentation is very thorough, and when I need to dive deeper I can look at the source code because it is open source.
What do you dislike about the product?
Sometimes I don't know an advanced feature exists until I see it is updated in the release notes or I stumble upon it in the source code or UI. It is likely a tough balance to avoid overwhelmign new users but more examples, tutorials, and hints to use advanced features could be helpful.
What problems is the product solving and how is that benefiting you?
Data ingestion pipelines. It allows me to automate these workflows, monitor them, and orchestrate them all in one place.
showing 61 - 70