Amazon DynamoDB + moonclerk Integrations

Amazon DynamoDB is a NoSQL database that allows customers to store data without the need for complex schema. DynamoDB stores data in tables which are partitioned across multiple servers. Each table is stored on multiple servers called “partitions”. The number of partitions per table is an integer value between 1 and 10,000. Data is stored with three primary keys. PartitionKey, RowKey, and Sort Key.

A partition key is used to determine where to store each item. A partition key can be any attribute or combination of attributes up to 256 KB in size.

A row key is used to identify each item within a partition. A row key can be any attribute or combination of attributes up to 256 KB in size.

A sort key is used to determine the order of items within a partition. A sort key can be any attribute or combination of attributes up to 256 KB in size.

Each table has a maximum of 5 GB data storage, but there is no limit on the number of rows per table. A single item can consist of up to 100 KB worth of data. Each item is stored as a set of attributes, where each attribute can be of either string or numeric type. DynamoDB does not provide native support for arrays of primitive data types. All data types need to be transformed into string format for storage in DynamoDB. There are four types of data provisioning options available on Amazon DynamoDB:

Per Second

Per Hour

Per Day

Per Month

Each provisioning option provides access to high availability (HA. and low latency database engine. Each provisioning option has limits on the amount of throughput, storage, and provisioned throughput capacity that can be used by all associated tables in an account. If any individual table exceeds the limits available on its provisioning option, then the entire account will start to incur additional charges. The limits are calculated based on the number of tables, total provisioned throughput capacity, the number of reads and writes, and the number of provisioned read and write operations per second. Every table has a maximum capacity that cannot exceed 1 million rows per day, and a maximum storage capacity that cannot exceed 5 GB. Every item within a table uses at least 256 bytes of storage space. If provisioned throughput is exceeded, then the provisioned throughput will be throttled at 15% per hour for 24 hours.

Moonclerk is a NoSQL database server written from scratch with an emphasis on performance, scalability, and security designed to run on commodity hardware inside a datacenter or out in the cloud, and it supports integration with other technpogies that you may already be using such as Memcached and Redis. This open source NoSQL database system was created by Bob Ipppito who worked at Rackspace as a Performance Architect until February 2011. The name moonclerk comes from a combination of MySQL, Redis, and CouchDB. In addition to being an open source project, Moonclerk also has several commercial support packages as well as pre-built AMI’s for those wanting an off-the-shelf spution. Moonclerk features include:

In-memory storage engine built with optimizer and compression built-in

Simple and flexible data model – store documents and fields referenced by keys and indexes

Powerful query language – SQL-like syntax that allows filtering and sorting by keys/fields only once

Built-in caching – transparently uses popular memory caching systems such as Memcached and Redis

Transparent serialization – JSON over TCP, binary protocps such as MRB and BSON over TCP/IP, and internal binary representations such as Java Serialization over TCP/IP or UDP/IP

Built-in replication – cluster mode uses consistent hashing for distributing writes and consistent replication for distributing reads; master/slave mode replicates writes and reads directly to slaves using native protocp (e.g., TCP/UDP)

Built-in load balancing – server instances can be added or removed dynamically without downtime; member nodes use consistent hashing algorithm for assigning keys; keys are distributed evenly across all nodes; nodes communicate via multiple independent channels (e.g., UDP. with optional encryption (SSL. to maintain high speed and reliability; load balancing instances can be chosen based upon availability (active vs. passive), latency (local vs remote), or bandwidth (high vs low.

Dynamic configuration – configuration parameters can be changed remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requiring a restart; new nodes can be added remotely while the system is running without requesting any downtime to existing clients. Within minutes after adding instances to an existing cluster, they are ready for reads/writes provided that they have been configured correctly. This enables seamless horizontal scaling in web applications when load increases beyond expectations.

The process to integrate Amazon DynamoDB and moonclerk may seem complicated and intimidating. This is why Appy Pie Connect has come up with a simple, affordable, and quick spution to help you automate your workflows. Click on the button below to begin.