DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports Events Over 2 million developers have joined DZone. Join Today! Thanks for visiting DZone today,
Edit Profile Manage Email Subscriptions Moderation Admin Console How to Post to DZone Article Submission Guidelines
View Profile
Sign Out
Refcards
Trend Reports
Events
Zones
Culture and Methodologies Agile Career Development Methodologies Team Management
Data Engineering AI/ML Big Data Data Databases IoT
Software Design and Architecture Cloud Architecture Containers Integration Microservices Performance Security
Coding Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
Culture and Methodologies
Agile Career Development Methodologies Team Management
Data Engineering
AI/ML Big Data Data Databases IoT
Software Design and Architecture
Cloud Architecture Containers Integration Microservices Performance Security
Coding
Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance
Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
  1. DZone
  2. Testing, Deployment, and Maintenance
  3. Deployment
  4. API Integrations Running in Your AWS Infrastructure

API Integrations Running in Your AWS Infrastructure

Let's take a look at what Streamdata.io is rolling out: a new line of serverless API integrations using AWS Lambda. What are the benefits?

Kin Lane user avatar by
Kin Lane
·
Jul. 19, 18 · News
Like (4)
Save
Tweet
Share
5.96K Views

Join the DZone community and get the full member experience.

Join For Free

We are rolling out a new line of serverless API integrations using AWS Lambda to help our customers stream data from existing APIs into their AWS infrastructure. We are beginning with AWS Lambda functions that stream data from common API data sources into Amazon S3 data lakes, but we are also planning for connectors that will stream into relational and non-relational database stores, as well as POST to external systems using webhooks. This makes it easy for any company, organization, institution, or government to stream data into their existing AWS infrastructure.

You hear a lot of discussion around on-premise and delivering software solutions within a company's own data center, but we find that making sure we can deliver on-premise solutions within customer's existing cloud infrastructure to be even more important. With the healthy lead Amazon enjoys in the cloud market, we find that empowering our customers to stream data within their existing AWS infrastructure is a great place to begin. We find AWS Lambda to be one of the most plug-and-play and easiest to install approaches for deploying streaming solutions within our customer's existing AWS infrastructure — making it the first place we are investing our time and energy when it comes to cloud connectors.

To find all of our AWS Lambda scripts we have been building, all you have to do is search for "Streamdata" in the AWS Serverless Application Gallery We only have four published there currently, allowing you to stream stock market, Stack Exchange, Reddit, and Twitter data. However, we are working on publishing more serverless streaming solutions from the APIs we've published in the Streamdata.io API Gallery and identified to have value when it comes to streaming data. All of the serverless functions are designed to stream into Amazon S3 data lakes, but if you'd like to have them publish to other AWS infrastructure, please let us know; we are happy to prioritize our work based upon your needs.

After we get approximately 50 serverless connectors published to the directory, we are going to move to the delivery of more seamless streaming solutions, where your usage is added to our AWS infrastructure bill, and you won't need to set up a Streamdata.io account if you don't want to. Our goal is to abstract away the account set up for not just Streamdata.io, but also for the APIs we are providing connectors for, allowing for seamless streaming of data into your existing AWS infrastructure, consolidating all billing into your AWS bill as well. This makes it easier for data consumers to consolidate the access and billing for hundreds or even thousands of separate data sources into a single AWS solution, consolidating the technical integration and business billing into a single frictionless solution.

AWS API Infrastructure Integration Data (computing) AWS Lambda

Published at DZone with permission of Kin Lane, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

Popular on DZone

  • How To Validate Three Common Document Types in Python
  • What Is Policy-as-Code? An Introduction to Open Policy Agent
  • Web Application Architecture: The Latest Guide
  • Why It Is Important To Have an Ownership as a DevOps Engineer

Comments

Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com
  • +1 (919) 678-0300

Let's be friends: