Category Archives: Technology

AWS Adventures, Part 3 – HA Wowza Live HLS

For a number of years, we have streamed HLS video via CloudFront, using a Wowza Streaming Engine server to convert our RTMP streams to HLS on the fly. CloudFront provides almost infinite scalability for the HLS stream, since the static chunk files are highly cacheable.

For high availability purposes, we want to use two independent WSE servers in two AWS availability zones. But this has been problematic. The two servers are never 100% in sync with their HLS chunking of the incoming live stream. This can cause the client to get a bad response to a request, thereby dropping the live stream.

After a lot of experimentation, I have come up with a way to assemble a multi-AZ, high availability cluster of WSE servers that can reliably stream HLS video from an incoming RTMP stream.

Continue reading AWS Adventures, Part 3 – HA Wowza Live HLS

AWS Adventures, part 2 – high-availability FTP service

In our AWS migration, we found it necessary to run an FTP server. Yeah, I know — “FTP? In the 20-teens?”. Look, I get it — nobody wants to run an FTP server in this day and age. But it is still a convenient way for partner companies to transfer data to us via automation. This isn’t highly sensitive data; our main concern is keeping the FTP server isolated from our other services so that any vulnerabilities there don’t propagate to more critical systems.

At any rate, we found it surprisingly challenging to build a highly available FTP service in AWS.

Continue reading AWS Adventures, part 2 – high-availability FTP service