Hi Everyone, my first post in the forum.
I have a python script I’ve been running at home. I queries ~200 web pages to check for updates in any of my various work groups. The system only provides hourly emails - I want notification on 10 minute intervals - so I wrote a polling script.
It uses aiohttp and asyncio pretty heavily to do the intial session login and set up credentials and then farms out and harvests all the 200 requests into a list of groups with activity - if any.
When I ported this to Lambda - I had to cut out all the asyncio and use straight synchronous requests. The Lambda function timed out after 6s… So I’m not doing this right.
Should I be thinking about this by:
- having the initial trigger check for a valid login session - otherwise creates one
- creates a loop for all active teams and triggers a different Lambda function to check each group
- some kind of harvesting function that is triggered once all the groups are finished
Is this the serverless way to architect this?
How would 3) get triggered?
Thanks for helping out! Cheers, jas…