Tag: part

Feed: The Internet of Things on AWS – Official Blog. Author: Channa Samynathan. The following is a survey paper, published and presented to the Academic Congress of Embedded World 2022 at Nuremberg, Germany on June 21st 2022. Part 1 – Scaling for Complexity – Architecting for Performant Embedded Devices at the Edge – Part 1 Provisioning LayerThe provisioning layer of your IoT workloads consists of the Public Key Infrastructure (PKI) used to create unique device identities and the application workflow that provides configuration data to the device. The provisioning layer is also involved with ongoing maintenance and eventual decommissioning of devices ... Read More

Feed: The Internet of Things on AWS – Official Blog. Author: Channa Samynathan. The following is a survey paper, published and presented to the Academic Congress of Embedded World 2022 at Nuremberg, Germany on June 21st 2022. Abstract Embedded edge devices with multi-sensor data sources are proliferating at an accelerating rate. Devices must be designed, manufactured, installed, connected, and controlled through seven distinct logical layers to securely connect and interact with complementary cloud-based and edge-based components to deliver business value. These Internet of Things (IoT) applications must gather, process, analyze, and act on data generated by the connected devices. In ... Read More

Feed: Cloudera Blog. Author: André Araújo. Posted in Technical | June 28, 2022 9 min read In a previous blog of this series, Turning Streams Into Data Products, we talked about the increased need for reducing the latency between data generation/ingestion and producing analytical results and insights from this data. We discussed how Cloudera Stream Processing (CSP) with Apache Kafka and Apache Flink could be used to process this data in real time and at scale. In this blog we will show a real example of how that is done, looking at how we can use CSP to perform real-time ... Read More

Feed: AWS for SAP. Author: Ferry Mulyadi. Introduction Cloud Security is job zero at AWS. We have a Shared Responsibility Model where customer assumes responsibility and management of the guest operating system (including updates and security patches), other associated application software as well as the configuration of the AWS services. A common question that new customers ask is how they can secure their mission critical SAP workloads. AWS has recently introduced AWS Well-Architected Framework for SAP (SAP Lens), which describes the best practices when implementing security control based on your requirement. One of the best practice is to ensure that ... Read More

Feed: Microsoft Azure Blog. Author: Takuto Higuchi. Robustness is the ability of a closed-loop system to tolerate perturbations or anomalies while system parameters are varied over a wide range. There are three essential tests to ensure that the machine learning system is robust in the production environments: unit testing, data and model testing, and integration testing. Unit testing Tests are performed on individual components that each have a single function within the bigger system (for example, a function that creates a new feature, a column in a DataFrame, or a function that adds two numbers). We can perform unit tests ... Read More

Feed: Planet PostgreSQL. When Disco was the hot new music, the people who built database management systems based their praxis around the then-correct assumption that hardware was extremely expensive, and hence that procuring things like more storage, let alone more machines on which they would run, could be counted on to require significant capital resources. This could only happen on the time scale of quarters, even if it was deemed worthwhile to fight the fights needed to procure them.The above conditions informed the practice of hardening single nodes against failure without adding significant hardware resources in the process. This practice ... Read More

Feed: Microsoft Azure Blog. Author: Takuto Higuchi. Testing is an important exercise in the life cycle of developing a machine learning system to ensure high-quality operations. We use tests to confirm that something functions as it should. Once tests are created, we can run them automatically whenever we make a change to our system and continue to improve them over time. It is a good practice to reward the implementation of tests and identify sources of mistakes as early as possible in the development cycle to prevent rising downstream expenses and lost time. In this blog, we will look at ... Read More

Feed: AWS Compute Blog. Author: James Beswick. This post is written by Chris Williams, Solutions Architect and Thomas Moore, Solutions Architect, Serverless. Part 1 of this blog series looks at optimizing AWS Lambda costs through right-sizing a function’s memory, and code tuning. We also explore how using Graviton2, Provisioned Concurrency and Compute Savings Plans can offer a reduction in per-millisecond billing. Part 2 continues to explore cost optimization techniques for Lambda with a focus on architectural improvements and cost-effective logging. Event filtering A common serverless architecture pattern is Lambda reading events from a queue or a stream, such as Amazon ... Read More

Feed: AWS Compute Blog. Author: James Beswick. This post is written by Chris Williams, Solutions Architect and Thomas Moore, Solutions Architect, Serverless. When you develop and architect solutions, cost-optimization should always be part of the process. This is no different for serverless applications that have been developed using AWS Lambda. Your workloads may vary in terms of complexity, usage patterns, and technology. However, the following advice is applicable to all customers when deciding how to prioritize cost optimization with the tradeoffs of developing the application: Efficient code makes better use of resources. Consider the downstream services in architectural decisions. Optimization ... Read More

Feed: SingleStore Blog. Author: . If you want to use Kubernetes to orchestrate SingleStoreDB instances, you’re part of a growing crowd. But deploying Kubernetes in a production environment is far more complex than a few clicks in a wizard. Too daunting? There’s good news: SingleStoreDB offers fully managed and self-managed services for Kubernetes. Easy!If you’ve gotten through Part 1 and Part 2 of my blog, congratulations and thank you. It’s not easy to realize that building a Kubernetes production environment requires a data center’s worth of engineering and network expertise. To recap those blogs’ main points, here’s what you absolutely ... Read More