This is part one of a two part post on how to set up transfer data from Redshift to an SFTP server, using S3 as transient storage, and Lambda as the processing function. Part two will deal with the S3/Lambda configuration and permissions (IAM). This first part deals with how to package and deploy a Lambda expression, written in Python3, with . . .
One small commit for a man, one giant leap for a team
We are now running on the Python 3.6 runtime. This has been a significant challenge - we have 170k lines of python code, and we'd paid no attention to the upgrade path before we decided to tackle it. We'll write a full technical post on how we did it, but in the meantime, I'd like to say a big thank you to those involved - . . .
First off, a definition: if you came here hoping for a lesson in functional programming, I apologise for my loose use of terminology - I'm not talking about those side effects.The side effects I am referring to are what I would term external side effects - which we are defining as those that effect systems outside of the Django ORM . . .
If you are using Django's
choices option on a model field, you have probably come across the situation where adding / updating a choice generates a new migration. If you are using choices liberally for things that are variable over time (e.g. "where did you hear about us?") this can generate a lot of unnecessary migrations.
Take . . .
Timing the switch from "minimum viable" to "maximum value".
J-Class yacht "Lionheart" - 'minimum viable' was never part of the brief
Before we started building YunoJuno I invited my two co-founders to join me at the London leg of Eric Ries' launch promotion for "The Lean Startup". They both went to the wrong venue, so never got to see Mr Ries, but that's their . . .
Incorporate NPS surveys into your project to have maximum insight
tl;dr Our latest project (django-nps) allows you to run continuous, rolling NPS surveys, and to segment NPS by any user attribute.
NPS (Net Promoter Score) is a well-known methodology for capturing user 'satisfaction' with your product. I won't go into the details here - there's a wealth of info elsewhere on the web - but . . .
tl;dr We’ve released django-package-monitor, a django app to make it easier to see which packages are out of date.
UPDATE: I messed up the setup.py dependencies in the original package, and the latest package depends on a source install of
semantic_version, so you will need to use the
--process-dependency-links option when installing dpm. See . . .