Optimize DevOps efficiency and cost through Serverless Architecture (AWS Lambda)

Spread the love

We are back with another interesting experience. This time we had to cut down the operational effort to focus better on innovation in products. In B2B domain, always expect customer specific customization to meet the need of users. At the same time, it’s a good idea to make product generic and maintainable. Though we always follow best practices to ensure maintainable code, but complexity increases with increasing number of specific jobs, analytics compilation, logs, monitoring, custom scheduled reports, etc., instead of hosting entire application including random specific tasks on an EC2, we decided to move few tasks on AWS Lambda.

AWS Lambda is one of the ways to implement serverless architecture. Lambda is completely event driven and only runs when invoked. Generally it’s good for cases where high number of requests have to be handled at unpredictable times, in other words, services having quiet periods followed by peak in traffic, making it an efficient way to ensure scalability and avoid unused server capacity.

Use Cases

We implemented Lambda in Chatbots (Surbo) for Channel Services and observed unutilized server and uncertain spikes (few instances in a week based on triggered campaign) in few channel services. Also requests were not long running hence we decided to move such cases (or service) to AWS Lambda. This helped us to handle the peak and save costs for allocated instances or resources.

Another case is of a Marketing Automation Product (Infinito) which was hosted on our data center; here we exposed AWS Lambda for short running, high volume Delivery Report (DLR) processing. Delivery report handling was written in NodeJS and due to heavy peaks it got difficult to successfully process requests and also scalability was a big concern. Hence we moved the NodsJS handling part to Lambda so now request gets handled in Lambda which further pushes the data to DB in data center.

The good thing about NodeJS is that we don’t miss out on any request. But with more concurrent requests, the request time against each request tends to get higher & higher. Check the below stats:

Total Requests:1000
Concurrency Requests:100
Time taken for tests:1.277 seconds
Failed requests: 0
Time per request: 127.730 [ms] (mean)
Longest Request:175 [ms]

Total Requests:10000
Concurrency Requests:1000
Time taken for tests:54.611 seconds
Failed requests: 0
Time per request: 5461.053 [ms] (mean)
Longest Request: 54581 [ms]

As you can see from the stats, with a 10 fold increase in overall load, the same system showed a 50 fold decrease in request processing performance.
The demand of the system was to react on every event, DLR being the primary event, as real time as possible. Hence, lowering the request time was of prime importance. Since, marketing campaigns are time bound, scaling the hard metal servers was not a good choice to go for as relatively expensive (again adding that this application on our data center). This is where AWS Lambda perfectly fitted in, scale for short peak hours and deliver performance while saving on money. We were able to lower the ‘Time per request’ to few ms with the help of AWS Lambda.

Simple to implement / Considerations

For implementation, we upload the individual function to Lambda, and call it using the API Gateway, one of the triggers available to initiate function call. This allow us to only invoke service or method when needed, serve the request depending on traffic and scale on peaks. No more instance monitoring along with reduced cost as billing on number of requests executed.

As a best practice, do ensure to regularly ping the Lambda function to avoid missing any traffic as a cold start take time ranging from a few seconds to few minutes. Cold start is basically duration of time to provision the selected runtime container and then runs your function.

Note: You must go through default limits of AWS Lambda and get it extended on request

Besides benefits, we could not really control the setup and were unable to install few custom packages required for application on the running environment, due to which we had to make some change in the execution approach by orchestrating and organizing our function to work.

Server-less architecture depends on your requirement and decision whether it makes sense for your application. AWS Lambda has resolved the problem of deploying the code with the environment setup, and decouple it with the server’s architecture, make it more resilient.

This makes it possible for teams to focus better and divert resources on innovation. To know more, feel free to send us an email on marketing@vfirst.com or leave a comment below.

Spread the love

Previous Posts How SMS Marketing can get your brand loyalty up

Next Posts Actionable Analytics in Real Time with Spark Streaming & Kafka

Comments (90)

Joy
21 Jul 2020

https://waterfallmagazine.com

Since the admin of this web page is working, no doubt very quickly it will be renowned,
due to its feature contents.
Carlota
08 Aug 2020

I got this web page from my friend who told me concerning this website
and now this time I am visiting this website and reading very informative articles or reviews at this place.
adreamoftrains web hosting sites best hosting
Rosalinda
08 Aug 2020

Thank you for the good writeup. It actually was a enjoyment account it.
Look complex to far introduced agreeable from you!
However, how can we keep in touch?

my site web hosting sites
Darrell
09 Aug 2020

Hey! I could have sworn I’ve been to this site before but after checking through some of the post I realized it’s new
to me. Nonetheless, I’m definitely delighted I found it and I’ll be book-marking
and checking back often!

my site; web host
Tamil Songs
09 Aug 2020

Superb website you have here but I waas wondering if you
knew of any community forums thaat cover the same topics
discusseed in this article? I’d really like tto be a part
of community whedre I can get advice from other knowledgeable individuals that
share the same interest. If you hwve any suggestions, please let me know.
Bless you!
https://www.mplyrics.com
Christiane
14 Aug 2020

What’s up to all, how is the whole thing, I think every one is
getting more from this web hosting providers page, and your views
are fastidious designed for new people.
Garrett
14 Aug 2020

Hi there! Do you use Twitter? I’d like to follow you if that
would be ok. I’m undoubtedly enjoying your blog and look forward to new updates.
Inge
24 Aug 2020

I’ve read several excellent stuff here. Definitely value bookmarking for
revisiting. I wonder how a lot attempt you set to make this type of excellent informative
website.
Cierra
24 Aug 2020

Every weekend i used to pay a visit this web page, because i
want enjoyment, for the reason that this this website conations genuinely pleasant funny
data too.
Yetta
24 Aug 2020

Hi! This is my first visit to your blog! We are a team of volunteers
and starting a new initiative in a community
in the same niche. Your blog provided us beneficial information to work on.
You have done a wonderful job! cheap flights 34pIoq5
Crystle
25 Aug 2020

Hi are using WordPress for your site platform? I’m new to the blog world but I’m
trying to get started and set up my own. Do you need any html coding expertise to make your
own blog? Any help would be really appreciated! cheap flights y2yxvvfw
Calvin
25 Aug 2020

When I initially left a comment I appear to have clicked the -Notify me
when new comments are added- checkbox and from now on every time a comment is added I receive four emails with the same comment.
Perhaps there is a means you are able to remove me from that service?
Thanks a lot! 32hvAj4 cheap flights
Carissa
25 Aug 2020

I know this website presents quality depending articles and additional information, is
there any other web page which gives these kinds of stuff in quality?
cheap flights yynxznuh
Gudrun
25 Aug 2020

I like the valuable info you supply for your articles.

I will bookmark your weblog and test once more
here regularly. I am rather certain I will learn a lot of new stuff right right here!
Best of luck for the next!
Raleigh
25 Aug 2020

Hello, i feel that i saw you visited my website thus i
came to return the choose?.I’m attempting to in finding things to enhance my site!I
suppose its adequate to make use of a few of your ideas!!
2CSYEon cheap flights
Lucile
26 Aug 2020

WOW just what I was searching for. Came here by searching for cheap flights
Deloris
27 Aug 2020

My programmer is trying to persuade me to move to .net
from PHP. I have always disliked the idea because of the costs.

But he’s tryiong none the less. I’ve been using WordPress on a variety
of websites for about a year and am concerned about switching
to another platform. I have heard very good things about blogengine.net.
Is there a way I can import all my wordpress posts into it?
Any help would be greatly appreciated!
Melba
27 Aug 2020

Superb blog you have here but I was curious if you knew of any community forums
that cover the same topics discussed here? I’d really love to be a part of
online community where I can get comments from other experienced people that
share the same interest. If you have any suggestions, please let me know.
Thank you! 3gqLYTc cheap flights
Kelvin
28 Aug 2020

I blog frequently and I genuinely thank you for your information. The article has
truly peaked my interest. I am going to book mark your website and keep checking for
new details about once per week. I opted in for your RSS feed as well.
Dewey
31 Aug 2020

Every weekend i used to go to see this website, because i wish for enjoyment, as this this web
site conations in fact nice funny data too.
Davis
05 Sep 2020

My partner and I stumbled over here from a different page and
thought I might check things out. I like what I see so
now i’m following you. Look forward to finding out about your web page for
a second time.
Richard
05 Sep 2020

I am not sure where you’re getting your info, however good topic.
I needs to spend a while studying much more or working out more.

Thanks for excellent info I was searching for this info for my mission.
lose weight
29 Sep 2020

Please can I pass around your blog on Google+? It’s very eloquent!
win money in real life free games
16 Oct 2020

win money slots no deposit
Victorevill
17 Oct 2020

So, they do terribly acme to culprit cyst (that do). rx tadalafil one to ventricular contractions which have wee institute that does.
JamesBop
21 Oct 2020

Orthodox rove is ordinarily the most successful stewardship surgical online. cialis otc categorize that HIV disposition also be administered to surgical procedures.
free money
23 Oct 2020

learn to win money
buy domain at cheap price
24 Oct 2020

autosurf
buy domains canada
25 Oct 2020

buy domains
buy domain blue host
25 Oct 2020

buy domains
buy domain edu
26 Oct 2020

buy domains
buy domains for cheap
26 Oct 2020

buy domains
Stephenhor
27 Oct 2020

is viagra over the counter buy viagra buying viagra online
Carolann Lomeli
03 Nov 2020

Sbobetindo ialah agen situs ion casino club login pendaftaran Indonesia resmi terpercaya.
아레나 먹튀
09 Nov 2020

Best view i have ever seen !
flomax and dapoxetine side effects
15 Nov 2020

flomax and dapoxetine side effects https://dapoxetine.confrancisyalgomas.com/
강원랜드 블랙잭
16 Nov 2020

Best view i have ever seen !
Ray Dichiaro
16 Nov 2020

Fantastic items from you, man. I’ve be aware your stuff previous to and you are simply too excellent. I actually like what you have acquired right here, really like what you are stating and the way in which in which you say it. You’re making it entertaining and you continue to care for to stay it wise. I can not wait to read far more from you. That is actually a terrific web site. This one is great $3 hosting with FREE .com domain and free SSL included: https://bit.ly/3DollarHost
does hydroxychloroquine really work
16 Nov 2020

does hydroxychloroquine really work https://hydroxychloroquine.webbfenix.com/
vidalista dosage
18 Nov 2020

vidalista dosage https://vidalista.mlsmalta.com/
https://www.vfv79.com/baca/
18 Nov 2020

It is best to take part in a contest for one of the finest blogs on the web. I will suggest this site!
바카라사이트
https://liveone9.com/
18 Nov 2020

At last I got a web site from where I know how to in fact get helpful information concerning my study and knowledge.
카지노사이트
https://txt2080.com/woori/
18 Nov 2020

Very nice post. I just stumbled upon your weblog and wanted to say that I have truly enjoyed browsing your blog posts.
우리카지노
clomid pct plan
19 Nov 2020

clomid pct plan https://salemeds24.wixsite.com/clomid
vidalista 20mg price in india
22 Nov 2020

vidalista 20mg price in india https://vidalista.buszcentrum.com/
high dose suhagra effects
23 Nov 2020

high dose suhagra effects https://suhagra.buszcentrum.com/
treating heartworms with ivermectin
23 Nov 2020

treating heartworms with ivermectin https://ivermectin.webbfenix.com/
what sildenafil citrate tablets used for
24 Nov 2020

what sildenafil citrate tablets used for http://droga5.net/
ivermectin dose for children
25 Nov 2020

ivermectin dose for children https://ivermectin.mlsmalta.com/
get hydroxychloroquine online
26 Nov 2020

get hydroxychloroquine online https://hydroxychloroquine.mlsmalta.com/
Pasquale Huett
01 Dec 2020

Como si mirasemos por el ocular de un microscopio, Eco laboratorio es un blog ambiental que trata de ver mas de cerca todo aquello que nos rodea.
Wyatt Dollak
01 Dec 2020

Entre los diferentes tipos de lavadoras de la firma que reparamos se ecuentran las que disponen de doble función de secadora, las extra silence y las integrables. En estos casos, desaconsejamos que intente extraer el material de obstrucción usted mismo, ya que podría dañar el conducto, siendo necesario el recambio de la pieza y que contacte con nuestro servicio técnico antes de que se produzcan filtraciones. A mí me estafaron 30€ (me tuvieron que devolver 70 de los 100 que había dado de señal para comprar los repuestos que 4 meses después no los recibían”).
is vidalista from china safe
03 Dec 2020

is vidalista from china safe https://vidalista40mg.mlsmalta.com/
pain medication without doctor prescription
03 Dec 2020

pain medication without doctor prescription https://buymeds.mlsmalta.com/
guidelines for prescription refills
06 Dec 2020

guidelines for prescription refills https://medpills.bee-rich.com/
cheap cialis online canada
06 Dec 2020

cheap cialis online canada https://wisig.org/
amstyles.com
08 Dec 2020

amstyles.com https://amstyles.com/
latest on hydroxychloroquine for covid 19
08 Dec 2020

latest on hydroxychloroquine for covid 19 https://hydroxychloroquinee.com/
Btrfs
09 Dec 2020

Collect as many tickets as you can before the timer ends to increase your chance of winning. A provably fair lottery picks out 10 lucky winners every Sunday. click here for go to freebtc http://freebitco.in/?r=14268596&tag=08122020
Btcc 2014
11 Dec 2020

Win a Rolex or $15,000 in Free BTC http://freebitco.in/?r=14268596&tag=11122020
BTCJam
11 Dec 2020

Win a Rolex or $15,000 in Free BTC http://freebitco.in/?r=14268596&tag=11122020
pills like dapoxetine at gnc
11 Dec 2020

pills like dapoxetine at gnc https://ddapoxetine.com/
how cenforce works best
15 Dec 2020

how cenforce works best http://cavalrymenforromney.com/
non addictive sleeping pills prescription
17 Dec 2020

non addictive sleeping pills prescription https://edmeds.buszcentrum.com/
prednisone 48 tablet therapy pack
18 Dec 2020

prednisone 48 tablet therapy pack https://prednisone.bvsinfotech.com/
what is cialis 5 mg used for
18 Dec 2020

what is cialis 5 mg used for https://atadalafil.online/
yasmin tablet price india
19 Dec 2020

yasmin tablet price india https://hydroxychloroquine.grassfed.us/
Bt corn
21 Dec 2020

4.61907993 BTC PRIZE POOL ON THE LINE Play early to win a higher share of prize pool http://freebitco.in/?r=14268596&tag=scrapebox
p autosurfing
21 Dec 2020

autosurf manuel
Btrfs
25 Dec 2020

4.61907993 BTC PRIZE POOL ON THE LINE Play early to win a higher share of prize pool http://freebitco.in/?r=14268596&tag=scrapebox
buy generic cialis online without a prescription
26 Dec 2020

buy generic cialis online without a prescription http://cleckleyfloors.com/
Josiah Colgan
28 Dec 2020

How to transfer firefox bookmarks from one laptop to another laptop?
btc direct
28 Dec 2020

4.61907993 BTC PRIZE POOL ON THE LINE Play early to win a higher share of prize pool http://freebitco.in/?r=14268596&tag=scrapebox
walgreens ivermectin citrate coupon
01 Jan 2021

walgreens ivermectin citrate coupon https://ivermectin1st.com/
Win btc free
01 Jan 2021

Surprise!! Scroll to the Bottom to Claim 1 Free Spin Win a Rolex or $15,000 in Free BTC http://freebitco.in/?r=14268596&tag=scrapebox
can hydroxychloroquine be purchased over the counter
03 Jan 2021

can hydroxychloroquine be purchased over the counter https://hydroxychloroquine.mymvrc.org/
cefixime pharmacy rx one
05 Jan 2021

cefixime pharmacy rx one https://ceefexime.co/
renault key card replacement
05 Jan 2021

I’d always want to be update on new blog posts on this site, saved to bookmarks! https://local-auto-locksmith.co.uk/renault/
stromectol msd
06 Jan 2021

stromectol msd http://ivermmectin.co/
cannabis oil
07 Jan 2021

I wanted to put you the very little remark to be able to thank you the moment again over the remarkable tactics you have provided on this page. This has been simply surprisingly open-handed with you to offer unhampered precisely what most of us would’ve offered for sale for an ebook to help make some money on their own, particularly seeing that you might have tried it in case you desired. Those suggestions in addition worked to become good way to realize that some people have the identical keenness really like my personal own to realize significantly more when it comes to this matter. I believe there are several more pleasant sessions up front for people who scan your site. https://nujemznuedi.online/
buy cbd
07 Jan 2021

I intended to compose you a bit of note in order to give many thanks again considering the awesome basics you’ve contributed above. It’s generous of people like you giving easily all a few individuals could have advertised as an e-book in making some bucks for their own end, and in particular considering that you could have done it if you considered necessary. The basics additionally acted as a easy way to be aware that many people have a similar desire just as mine to figure out a great deal more concerning this condition. Certainly there are a lot more enjoyable instances ahead for folks who check out your blog. https://nujemznuedi.online/
seroquel quetiapine
10 Jan 2021

I am glad for writing to make you know what a incredible encounter my friend’s girl gained studying your web page. She learned plenty of pieces, which include what it’s like to possess an awesome helping mood to let other folks smoothly know just exactly several multifaceted subject matter. You truly exceeded our own expectations. Thank you for offering these necessary, safe, explanatory and even fun tips about this topic to Julie. https://seroquelquetiapine.com/#
zyprexa no rx
10 Jan 2021

Thanks for the tips on credit repair on all of this blog. What I would advice people is to give up the mentality that they can buy now and pay later. As a society we tend to do this for many things. This includes vacations, furniture, and items we want. However, you need to separate your wants from all the needs. While you are working to improve your credit score you have to make some sacrifices. For example you can shop online to save money or you can go to second hand stores instead of expensive department stores for clothing. https://zyprexaolanzapine.com/#
tadalafil without a doctor prescription
28 Jan 2021

tadalafil without a doctor prescription https://cialis.webbfenix.com/
order generic cialis
28 Jan 2021

order generic cialis https://cialis.buszcentrum.com/
viagra better than cialis
09 Feb 2021

viagra better than cialis https://cialis.studiowestinc.com/
hydroxychloroquine generic name
11 Feb 2021

hydroxychloroquine generic name https://hhydroxychloroquine.com/
tadalafil without doctor prescription
11 Feb 2021

tadalafil without doctor prescription https://tadfil.online/
SPSS Assignment Help
13 Feb 2021

Want to submit the well-made SPSS assignments? No worries, get the SPSS Assignment Help here.
generic cialis usa pharmacy
24 Feb 2021

generic cialis usa pharmacy http://cialis.anafassia.com/