Just like a brain is an interconnected network of neurons, the Internet (or internet) is a global interconnected network of computers and devices that communicate with each other via the Internet protocol suite (TCP/IP). The communications infrastructure of the Internet consists of hardware components and a system of software layers that control various aspects of the architecture.

To create a new Internet from scratch, ThreeFold had to start at the operating system (OS) level. An operating system is a software that manages computer hardware, software resources, and provides common services for computer programs. And this is how Zero OS was born

🔗What makes Zero OS special?

Zero OS is a stateless and lightweight operating system. Given it has no shell, remote or server interface, it is much safer than the big majority of the OSs on the market. When storing your data on Zero OS, it is fingerprinted and made available only when requested by you or those you provide access to.

The state of an application represents its state of being in a given moment in time. Think of a stateless transaction as vending machines, a single request and a response. In ThreeFold’s Internet infrastructure, this can be represented as data being accessible only when requested. The only way to access data on Zero OS is via the private key (or fingerprint) of a user. In that sense, the data is not accessible unless the data owner requests access to it.

🔗How does Zero OS apply to developers?

Thanks to its lightweight architecture, Zero OS is a perfect fit to run microservice architectures and emerging IT workloads such as IoT, Blockchains, Big Data, and more. A key benefit of microservice architecture is the freedom it offers you to choose the best runtime for the task at hand.

Let’s take the example of decentralizing service-oriented developing teams. A common challenge there is that most of the time they don’t really understand the applications they are exposing. But no one knows the data infrastructure of the applications better than those who craft them.

ThreeFold permits decentralized developer teams with the ability to share keys (access) to the developing environment on Zero OS and the gateways to the world wide web within the secure peer-to-peer overlay network. This is game changing. Also with all the automation frameworks provided, it creates the perfect environment to develop current and emerging technologies.

Put shortly, decentralized development and integration is now officially an organizational or cultural change, not a technical one anymore.

🔗Zero OS allows anyone to provide sovereign capacity

Given stateless systems separate the OS configuration and user data, Zero OS simplifies the maintenance and the deployment of digital workloads, while making it impossible to hack into user data on a hardware level.

3Nodes provide all the storage, compute and network primitives for a new internet infrastructure. Given they are booted with Zero OS, anyone can now participate in the Internet economy without jeopardizing user data sovereignty and security.

Conclusively, Zero OS is ultra secure, perfect to develop current and future technologies, and enables anyone to take part in the planet positive and data sovereign Internet brought by ThreeFold.

Learn more about Zero OS and the grid primitives here.

For decentralized systems on Wikipedia, we learn; “One of the most well-known examples of a “natural” decentralized system is one used by insect colonies such as Ants. In these insect colonies, control is distributed among the biological agents who act upon local information and local interactions to create complex and universal behavior collectively. While individually exhibiting simple behaviors, these agents achieve universal goals such as feeding the colony or raising the brood using dynamical mechanisms like non-explicit communication and exploiting their closely coupled action and perception systems. Without any form of central authority, these insect colonies achieve their universal goals by performing required tasks and by responding to changing conditions in their external environment. They also adjust the number of workers performing each task to ensure the completion of all tasks. For example, ant colonies guide their global behavior (in terms of foraging, patrolling, brood care, and nest maintenance) using a pulsing, shifting web of Spatio-temporal patterned interactions that rely on antennal contact rate and olfactory sensing. While these interactions consist of both interactions with the environment and each other, ants do not direct the behavior of other ants. They thus never have a “central controller” dictating what is to be done to achieve global goals.“

So nature has provided us with solid examples of centralized and decentralized systems. For much of what works in the modern world, we have ended up using the centralized model governing enterprises and countries. Various industries have also adopted the centralized model where there is a pyramid structure, and everything works towards the alpha males.

A different approach to creating and operating IT workloads

What if we can develop a new concept for creating, deploying, and operating IT workloads. What if we say goodbye to the centralized way of controlling IT workloads. Can we develop an idea that works in a decentralized way?

The concept

To build this concept, we will draw the use of the human way of operating a large ship. The crew of a vessel has different roles, which we will call the coordinators. Some of these coordinators could be a captain, officers, engineers, and oilers. These coordinators have in-depth knowledge of their specific tasks but usually lack a detailed understanding of the other roles. In the “hive” of a ship, the specific requests to get tasks done are sent to coordinators who will receive, interpret, execute their particular tasks, and report the (non-) progress of these tasks or subtasks. For example, the captain will create and agree to a schedule of maintenance tasks for the engine room. These are daily, weekly and monthly tasks that should be completed by the engineers and oilers. The engineers and oilers do not get continuous input from the captain. They get one instruction to follow the schedule and know what needs to be done for every task. The intermediate state (what is complete and what still needs to be addressed) is stored by the coordinators executing the tasks. This is the most efficient way of accomplishing tasks.

Jumping to the IT industry

If we bring this concept to the IT world, we conclude that today’s IT systems are built in a significantly different way. Most architectures (if not all) have a central facility that stores all information and all states of activity in a so-called central ‘database.’ A general norm within IT. However, these types of architectures are inefficient and are very complex - like the ship analogy - a central command room (database) is created where every coordinator needs to report back. (1) The current level of activity, (2) the completion (state) of tasks, (3) the proper understanding of upcoming tasks by the coordinator to accomplish tasks in-progress or future - hence leading to the undesirable outcome of complexity due to centralization.

In the ship example, we deem this type of functioning/workflow inefficient; however, in the IT world, it is a common way of doing it. Furthermore, IT infrastructures usually have different databases to store “state” in different parts of the IT architecture. The analogy would translate to different command rooms that orchestrate different functions on the ship in our ship. This, in turn, introduces the need for another role in starting coordinating between the different command rooms to ensure that all information is shared and communicated. Taking this pattern forward leads to an endless loop of adding interfaces, layers, bridges between different parts of the system that all store information, multiple times, and in different ways.

Datastores

By design, a decentralized IT architecture should not use centralized data storage (databases) for multiple tasks (roles). It instead should feature a similar approach to the way of functioning as in the ‘ship’ example. In this architecture, roles get short and precise instructions of the jobs to be completed and autonomously execute. We call these execution engines coordinators. Coordinators receive instructions, run on instructions and store all information about the current task locally. They store all the relevant information in a local storage facility (available to the individual coordinators only) and provide information about the state of execution if and when other coordinators ask for a state update.

Magical Coordinator

Requirements to let actor based management work

• State only with the actor itself (no-where else !!!)

• Understood language between actors

• Process = recipes of a cook, NOT IN A DB
  
  

Actor based IT solutions

To simplify common IT architectures, we should look at a new way of creating such a system that takes the current standards into account:

• No people involved in integrating different components into a single solution

  • Which, as a consequence, means no revenue generation based on creating and managing complexity.

• No central state / operational data storage

• Individual automated actors with specific knowledge for specific tasks

• Independent operating actors completing specific tasks
  
  Such a system should ideally be owned by many (not just a single organization, bringing centralization back into the equations) that operate IT tasks for many. We have not seen such a system in existence, but we are as TFTech building and rolling out technology that can do this.
  
  We believe that IT’s future is in decentralization where specific coordinators (bots) will roam a network of capacity looking for a task to do, making themselves available where needed, creating more of them when the system grows, and allowing the global population to deploy and operate IT workloads.

Everything on the internet – websites, apps, photos, videos, etc – uses up capacity and is stored in huge data centers owned by big companies, mainly in North America, Europe, and some in Asia. In our solution, centralized data centers are replaced with a grid of “nodes” distributed around the world.

These nodes are owned by ThreeFold Farmers – but only the physical hardware – the data inside of the nodes belongs to the people or organizations who put it there. So, “farmers” plug in hardware and start to create capacity that can be used by people.

Farmers come in all shapes and sizes. Some farmers run small data centers while others simply run a node out of their living room.

When Farmers connect active hardware (add capacity) to the ThreeFold Grid, ThreeFold Tokens are created. Farmers can then sell those tokens to people who want to use capacity (e.g. a developer that wants to build or host a website, or a person who wants to store some photos). More on tokens down below.

Seems quite lofty. How will you build it?

It’s true that rebuilding the internet is not so simple. But a lot of infrastructure has already been built and the technology is quite advanced. Over the past 2+ years (as of May 2020), independent ThreeFold Farmers have already plugged in more than 40,000,000 GigaBytes worth of storage and 15,000 CPU Cores across 21+ countries. That might not mean a lot to non-technical folks but it is quite a significant amount.

21+ countries? What happened to equality?

As far along as we are, we still have work to do. One of our biggest goals in the near future is to expand the grid to Africa, South America, and parts of Asia where currently the Internet is too expensive or not available. Currently, we farming is incentivized around these key geographies.

And what do you mean by peer-to-peer?

Peer-to-peer means no middlemen – direct exchange of information and/or value between equal participants. Peer-to-peer means decentralization – breaking away from pyramid-based systems, greed-based systems – and putting people back in the center of their own (digital) lives.

So how can I access / use your internet today? What can I do on it?

By June, some of the first experiences will be live. This includes file storage and communication tools and a virtual browser, all with the advantages of being more sustainable for our planet and with full control of your own data. And over time, more and more experiences will come to this internet. We’ll be updating here and on our communication platforms as they come. But don’t worry, as a user it doesn’t change much – no coding required. :)

Will [enter website or app here] be available on your internet?

There are some tremendous reasons for a website or app to use our internet, but that will really be up to the website or the app. In the end, we are providing a responsible solution for responsible people and organizations. We would love to host anybody who believes in what we are doing!

How are you making sure it’s safe?

Hacking has become a part of life and is almost impossible to avoid in the current systems – they are too complex and require too many people to operate. This results in less security which results in lots of security breaches. We took a look at the existing Internet (seven layers) and simplified it down to three layers. By simplifying the architecture and instead creating technology that is self-driving & self-healing, we removed the human requirement and therefore vastly minimized the possibility for hacking or human error. Then we also developed a storage algorithm which makes it such that if some of the information gets lost or stolen (somehow) or if some hardware goes down, it is all retrievable. Long story short, we flipped the existing system on its head.

What about the data ownership part?

That has a bit to do with the security as well. Since you own your data, you decide who gets access. Which means your data isn’t just out “there” for the taking. Basically, we put you at the center of your digital life, where the applications and experiences you use serve you, not the other way around.

And how is it better for the planet?

There are a few reasons for us being more sustainable. Data centers are super unsustainable, so the simple (but incomplete) answer is “no more huge data centers.” But if you want more detail:

• We use up to 3x less hardware for the same output, and using hardware at least 2x longer while maintaining good performance
• Having capacity everywhere, local to where users are – this reduces network requirements (and can even improve security)
• Using new algorithms (e.g. the one mentioned above for storage) which have dramatic efficiency improvement
• Re-using hardware where possible – let’s not throw away

How much will it cost?

In the end we want to provide sustainable access to the internet and all of its solutions for less than a dollar per month per person but for now the cost will depend on what you choose to do. Certain experiences will cost money. Storing photos or videos, for example. But all at a fair price.

Speaking of money – so what’s up with the ThreeFold Token?

As we mentioned above, tokens are generated when ThreeFold Farmers adds capacity to the ThreeFold Grid.

Essentially, the ThreeFold Token is the medium of exchange on the new internet. So, if a developer wants to build something (e.g. a website or an app) or a user wants to store something (e.g. photos), he/she/they use(s) ThreeFold Tokens.

Need more answers?

We hope that helps explains things. Obviously there is a whole wiki to dive in to. If you don’t find what you’re looking for, please ask us on our forum!

Photo by Nong Vang on Unsplash.

🔗Decentralization

In 1989, the Internet changed the world as we know it with the introduction of the World Wide Web. With time the Internet empowered people to share information in a decentralized way. Shortly after, big companies like Facebook, Google, and Apple emerged, providing many solutions that revolutionized the way we live. The “sharing economy” has grown exponentially over the last 5-10 years. This is thanks to a more simplified information flow and well-developed technology, which:

• Enables a much easier integration of independent players into the sharing economy.
• Eliminates the need for extensive management and structure of marketplace operators.

We are entering a flat-structure economy. An economy where fewer managerial levels are needed for the system to function. New technologies such as blockchain and the Internet of Things facilitate this ongoing trend. Participants can now interact on a peer-to-peer basis, forming marketplaces and organizations according to pre-agreed, programmed contracts.

🔗The current Internet is centralized

Despite the growth in popularity for decentralized systems, organizations, and currencies, the Internet remains centralized. The centralization within the Internet industry brought many barriers to entry. Indeed, to compete in the highly competitive market of Internet capacity dominated by big IT companies, massive investment, and IT development are needed.

But what is really scary is that the current industry exploits the market tremendously. Data is officially the most valuable asset on earth for a few years, and about 20 companies rule over more than 80% of the cloud industry. In other words - these companies together have more than 80% of the world’s information. In recent years, we noticed the dangers that can arise with the wrong intentions within the data industry with the ‘Cambridge Analytica Scandal’, also highlighted in the movie ‘The Great Hack’.

ThreeFold has been developing technology that allows the decentralization of the Internet infrastructure - removing the need for data centers, and allowing anyone to take part in the Internet capacity market. Adding capacity to the ThreeFold Grid (TF Grid) makes you a ThreeFold Farmer (TF Farmer). The more decentralized the Internet gets, the more secure and effective it will become. The already is the largest grid of compute and storage in the world.

🔗How To Participate

The process of becoming a ThreeFold Farmer is very straightforward. Anyone can join the ThreeFold Grid by downloading the ThreeFold Zero-OS onto their nodes and connecting them to the ThreeFold Grid.

By doing this you will become an operator of a “micro data center” and with that earn ThreeFold Tokens. With or without experience in the field, anyone can become a ThreeFold Farmer. By becoming a ThreeFold Farmer, you empower a new neutral Internet that belongs to humanity - not corporations.

Blog written in 2019, updated January 2021.

Due to the billions of IoT devices driven by various use cases like autonomous driving, a massive demand for Edge Computing is evolving rapidly. According to the Digital Journal, the Edge Computing market is growing extremely fast. With a CAGR of over 35.0% and the market is expected to reach USD 33.75 billion by the end of 2023.
Source: http://www.digitaljournal.com/pr/3394129

Edge Computing and Grid Computing are often used in the same context and sometimes are confused. For this article, we’d like to define the terms going forward as follows:

Grid Computing means a computer network of 100% distributed computer resources like processing power, memory, and data storage of similar or different types to which authorized people can run their computation workloads. That means that Grid Compute nodes are mostly in data centers and maybe dispersed over more extensive regions but are typically still far from the Edge. Compared to Edge Computing, Grid Computing environments are owned by more than one individual or company, and thus, controlled by many.

Edge computing has risen from a need to have data processing and storage as close as possible to real-world situations. The situation could be as simple as recording biometric data by a smartwatch to support the required information for a self-driving car to function as intended. The necessity comes from having local computing and storage capacity - it can be used by multiple use cases (situations) but does not have to.

The Benefits of Edge Computing

Edge computing comes with specific benefits that are mandatory for the next evolution in the IT industry. We have optimized the central model to such a degree that the network connects the central capacity to use cases in the field, the next bottleneck. Edge computing is solving several challenges faced by real-world situations with the following benefits:

Speed

Speed is probably the most crucial benefit of edge computing, as there are plenty of use cases that require near-real-time computing.

Scalability

The scalability of edge computing also makes it incredibly versatile. By partnering with local data centers further out on the Edge, companies can easily target desirable markets without investing in expensive infrastructure expansion. Edge data centers allow them to service end-users efficiently with little physical distance or latency. They also do not constrain companies with a substantial footprint, allowing them to shift to other markets rapidly should economic conditions change.

Availability and Security

Traditional cloud computing architecture is, by definition, centralized, which makes it especially vulnerable to distributed denial of service (DDoS) attacks and power outages. Edge computing distributes processing, storage, and applications across a wide range of devices, nodes and data centers, which makes it difficult for any single disruption to take down the network which is why logically and geographically dispersed systems are often used for DDoS mitigation like in Content Delivery Networks (CDN)

By pushing everything to the cloud, you’re leaving your business open to ISP failures and cloud server downtime. Many mission-critical operations like railroads and chemical plants won’t even use the cloud today. Their server farms are the only way to guarantee uptime.

Process optimisation

Another big benefit is process optimization. If self-driving cars were to use the cloud instead of the Edge, they’d be pushing all the data they gather up to the cloud. But if the Edge makes local decisions, the cloud may not need all that data immediately – or even at all.

Requirements for Edge Computing

When compute and storage capabilities exist on the Edge, we need to overcome several challenges around capacity distribution. Most traditional IT technologies do not allow this as they live in large data centers where there is a lot of “care” for these technologies.

The most significant generic hurdle to overcome is that there is going to be a lot less “care” for the technology to rely on at the Edge. These “devices” have to be self-sufficient to no small degree. If we want to sum up some of the specifics of edge technology, this will come out:

• A typical edge device or node must run an OS that comes in at a low cost or, ideally, for free like some open source offerings. This enhances the proliferation of capacity at the Edge.
• Container technology must be embedded in the OS at the lowest possible level to create the maximum benefit of efficiency from the edge hardware: classic Virtual Machine environments are just too inefficient and resource consuming for edge use cases. There will be Virtual Machine based edge solutions, but these are going to be out there for a certain period, catering for current IT workloads to move to the Edge. The Edge’s correct move can only happen when traditional IT applications split up into pieces and require a lot less capacity to run. Hence, it will convert over time to containerized technology.
• Edge Computing hardware will consist of datacenter grade hardware and all sorts of other types of hardware. The Edge might include some smaller sized data center facilities but also include different types of “homes” for compute and storage equipment. Think of transportation as a specific use case - capacity on maritime vessels, capacity on trains, and vehicles’ capacity. Hardware will have to accommodate different use cases, price levels, form factors, and power consumption.
• Edge hardware needs a lightweight OS that is very close to the hardware components to get the maximum out of compute and storage capacity. Less is more - for real Edge capacity, local people won’t be able to interact with edge capacity - one further step - there will be no need to have remote people access these devices for maintenance purposes. The ultimate edge computing solution will have a significant amount of self-sustainability - where there are no more highly technically skilled people required to keep the capacity available, up and running.
• In most cases, Edge means being remote, and having no access to humans or humans are only too expensive for the specific use case.
• Power outages or no network availability will cause system failures. The ideal OS to deal with this revolves around no people; the zero-touch approach should be stateless and needs to have self-healing capabilities run by automation software robots.
  

Existing Edge Computing Solutions

Today there are a few Edge Computing platforms out there that cover some requirements as outlined above.

• Microsoft, for instance, launched products like Azure IoT Edge and Azure Data Box Edge to extend their Datacenter based Azure cloud offering to the Edge.
• Another attempt to bring centralized cloud technology to the Edge is the Openstack Edge Computing initiative, which is in the concept phase only so far.
• A new OS for the Edge is CoreOs, also known as Container Linux, which runs on nearly any platform, whether physical, virtual, or private/public cloud.
• More recently, there are a few blockchain-driven technologies out there pushing for edge capacity to exist. Examples are:
  • SIA
  • Sonm
  • Filecoin
• Content delivery networks with a lot of “capacity” sitting close to end-users are expanding their capabilities beyond content delivery
  • Limelight
  • Akamai
    
    
    

The Holy Grail

The holy grail would be a self-healing Edge Grid. Edge, because of all the benefits Edge Computing brings to the user: Speed, Scalability, Reliability, Security, Versatility, and Process Optimization. Grid, because it fulfills the distributed workload requirements, a classic centralized cloud would generally be used without a centralized nature and all its disadvantages.

Probably the most critical part of the ideal solution is self-healing. The biggest challenge of an Edge Computing environment is the dependency on local care: humans to maintain hardware and upgrade or fix software components. Self Healing needs to do the job here, which means zero people can be involved.

Only a self-healing mechanism with zero-people involved, completely decentralized, brings down the cost and provides more security to the environment, and makes it highly scalable.

Some of you may think that new blockchain-based technologies may be the holy grail. But they are not.

In most cases, their implementations are too slow, and that’s why it does not make sense to use them for production purposes. Another downside is the complexity of the application caused by stitching together 3rd party technologies. In many cases, these blockchain-based technologies are at a very early stage with beta implementations or even roadmap only type of technology.

The holy grail is something that hasn’t been created before; it needs to be a versatile system that is self-manageable. A large global conglomerate should not own the capacity - it should be owned by many. Therefore, it should have a commercial model where people individually can decide to partake in building this global edge solution and where there is a defined return on investment for those partakers.

A few groups of people, like us, are creating decentralized solutions for this, owned by the many, and creating services for all.