Last month we launched PerfGPT – AI-powered performance test results analysis web app powered by OpenAI’s da-vinci GPT model. It has been four weeks and the platform has more than 240 plus users and analyzed more than 200 plus test results. OpenAI consumed more than 580K tokens. In this blog post, I am going to share the cost insights of PerfGPT.
Table of Contents
PerfGPT Architecture
AWS
Below is the high level architecture of PerfGPT focusing on AWS components (high resolution format).
The following are the AWS services which are powering PerfGPT:
- CodePipeline
- Elastic Load Balancer
- Elastic Compute Cloud
- API Gateway
- Lambda
- DynamoDB
- Cloudwatch
- Secrets Manager
As you know, PerfGPT is an open source project. The source code is available to review on GitHub. Once the code is pushed to the main branch, AWS CodePipeline automatically kicks off the deployment process. Thanks to Continous Deployment.
For a mature and error-prone deployment, I have built an identical stage environment. This will increase the expense 2x. I had to do this, otherwise, I would be spending more time on my weekends fixing defects in the production environment.
Other Components
The following are the other components which are adding up to the monthly expense.
- OpenAI API usage
- PerfGPT.ai domain
Free Components
The following are the components which are being consumed by PerfGPT:
- New Relic
- Sentry
- Mixpanel
Domain
I procured the domain from NameCheap (affiliate link). TLS certificates from Cloudflare.
AWS Cost
Now, let us focus on the cost associated with each service. As forementioned, PerfGPT has two environments: stage and production.
Here is the cost explorer snapshot from AWS for the month of February 2023.
The total cost was $49. Most of the expense went towards EC2 and ELB which is approximately $40.
Open AI Cost
Now, let us see the OpenAI API usage for the month of February. I spent around $19 for 500K tokens.
AI TLD Domain Cost
Today, I registered and routed the traffic to PerfGPT.AI. AI TLDs are expensive. I was able to buy it for $134 for two years at NameCheap. If I delay, someone will purchase it :)
Overall Cost
The total cost of running PerfGPT per month (considering the domain name as well) is around $75 USD.
Right now, PerfGPT is free to use and limited to 10 uploads per month with 10 MiB file size.
If you are interested in sponsoring this cost, please contact me either on LinkedIn or Twitter. Happy to add your advertisement on the home page of PerfGPT.