ATA OVER ETHERNET
'ATA over Ethernet' ('AoE') is a network protocol developed by the Brantley Coile Company[1], designed for accessing ATA storage devices over Ethernet networks. It gives the possibility to build SANs with low-cost, standard technologies.
AoE does not rely on network layers above Ethernet, such as IP, UDP, TCP, etc. This means that AoE is not routable over LANs and is intended for SANs only. An alternative to iSCSI, the AoE specification is 8 pages compared with iSCSI's 257 pages.
The following OS provides native ATA over Ethernet support:
Coraid [3] provided the original device drivers for FreeBSD, and current versions are maintained by Stacey D. Son[4].
AoE support is currently being beta tested for the Solaris operating system, SPARC and x86.
A European based storage company, Rocket Division Software has added AoE support into their StarPort Storage Controller[5] for Windows, which is an iSCSI and AoE Initiator, RAM disk and Virtual DVD drive.
2DegreesFrost [6], a Bellingham, WA software company has shipped a driver for Mac OS X (10.4) providing AoE support.
The Coraid [7] company offers an ATA over Ethernet hard disk called EtherDrive.
Also the vblade program makes it possible to export hard disks using inexpensive computers running Linux. Two independent implementations of vblade exist: A userspace one (part of aoetools package) and another one implemented as a linux kernel module.
Although AoE is a simple network protocol, it opens up a complex realm of storage possibilities. To understand and evaluate these storage scenarios, it helps to be familiar with a few concepts.
The ATA in "ATA over Ethernet" is a kind of wire protocol for disk drives. Data is written
to the disk and read back from it in one or more fixed-size chunks of data called blocks.
The ATA over Ethernet protocol simply puts ATA commands into low-level network packets, so that an Ethernet network effectively replaces the cable that goes to the disk drive. Just as blocks of data can go to a disk drive through a ribbon cable in a computer, they can also go over ethernet cables.
The ribbon cable doesn't care what is inside of the blocks of data, and neither does AoE. You can read and write any blocks of data you want, but most of the time, a file system is used to organize the data.
Traditionally, a filesystem has been used on a computer that is the sole user of its hard disk. Filesystems like ext3, XFS, HFS+, and NTFS were designed with this assumption in mind.
When you use AoE, using an Ethernet network in the place of a cable, it's possible to violate that assumption. For traditional
filesystems, that is a dangerous thing to do, leading to filesystem corruption or kernel panics.
Cluster filesystems avoid the assumption that only one computer has access to the block device. They are designed to allow multiple members of a cluster of computers to use a shared block device safely, by coordinating their actions.
Examples of cluster filesystems are GFS and OCFS2.
SANs (Storage Area Networks) File Systems are another means to avoid this problem. MetaSAN is a SAN software package that supports AoE. It is produced by a European software company, Tiger Technology Sarl [8].
The AoE target is a hard disk, or something that appears to be a hard disk. A few key points regarding hard disks are:
★ Access speed is dependent upon disk RPM (rotational latency), head movement speed (seek time), magnetic density, accuracy of head alignment on the track, data location on disk, and interface electronics;
★ Random disk access speed is entirely dominated by seek time;
★
★ Random access is over 100 times slower than sequential access[9];
★
★ Single disk sequential access is typically 50-80 MB/s;
★
★ RAID generally improves sequential and random access performance;
★
★ Host OS and disk filesystem try to store data sequentially to help the disk perform (McKusick 1984).
The wikipedia article on Ethernet networks has more information,
but for AoE it is helpful to keep in mind the points listed below.
★ AoE packets use MAC addresses to indicate the source and destination. MAC addresses are the Ethernet-level addresses that are required for ethernet to work. A MAC address only works inside a single ethernet broadcast domain.
★ Current Ethernet hardware features include flow control, which helps to minimize the need for packet retransmission.
★ Ethernet uses Cyclic redundancy checks to ensure that packets arrive intact.
When using an Ethernet network to access block storage, there are several potential advantages:
★ It is easier to add storage capacity.
★ The amount of storage is practically unlimited.
★ Access can be controlled by creating ad hoc ethernet networks.
★ Common commodity hardware can be used.
★ Data backup may be easier.
★ Data may be shared instead of being confined to one computer.
The AoE protocol provides a mechanism for host-based cooperative
locking. When more than one AoE initiator is using an AoE target,
they must cooperate. The hosts need a way to avoid interfering with
one another as they use and modify the data on the shared AoE device.
The hosts can simply communicate, using, for example, TCP/IP to send messages to one another. Through
communication, the hosts can agree which host has the right to access
particular blocks on the shared storage.
Another option is to use the storage device itself as the mechanism
for determining the access of particular hosts. The AoE protocol
includes a "config string" feature. If more than one host tries to
set the config string, only one actually succeeds. The other host
receives an error. At that point, the "winner" is decided and the
winner can proceed to establish an access policy.
★ HyperSCSI
★ iSCSI
★ Articles:
★
★ ATA Over Ethernet: Putting Hard Drives on the LAN — Linux Journal (28 April 2005)
★
★ ATA-over-Ethernet enables low-cost Linux-oriented SAN — LinuxDevices.com (23 June 2004)
★
★ The ATA over Ethernet (AoE) Protocol — Linux Magazine (June 15th, 2005)
★ Protocol:
★
★ AoE protocol description (PDF file)
★
★ AoE protocol specification
★ Emulator and Tools:
★
★ ATA Over Ethernet Tools and vblade vblade is an AoE target that runs in userspace, and kvblade is an alpha in-kernel AoE target
★
★ vblade, implemented as a kernel module this is faster than the userspace vblade
★
★ qaoed - Mulithreaded ATA over Ethernet storage target Runs in userspace
★
★ Aoeserver - Mulithreaded ATA over Ethernet storage target Implemented as a kernel module
★ Live CD:
★
★ Slax Frodo with vblade and ATA Over Ethernet Tools this is useful for testing and backup
★ .
★
AoE does not rely on network layers above Ethernet, such as IP, UDP, TCP, etc. This means that AoE is not routable over LANs and is intended for SANs only. An alternative to iSCSI, the AoE specification is 8 pages compared with iSCSI's 257 pages.
| Contents |
| Operating system support |
| Hardware support |
| Related Concepts |
| Block Storage |
| Filesystems on block storage |
| Disk Drives |
| Ethernet |
| Network Storage |
| Config String |
| See also |
| External links |
| References |
Operating system support
The following OS provides native ATA over Ethernet support:
| OS | Date | Release |
|---|---|---|
| Linux kernel [2] | 2005-03-01 | 2.6.11 |
Coraid [3] provided the original device drivers for FreeBSD, and current versions are maintained by Stacey D. Son[4].
AoE support is currently being beta tested for the Solaris operating system, SPARC and x86.
A European based storage company, Rocket Division Software has added AoE support into their StarPort Storage Controller[5] for Windows, which is an iSCSI and AoE Initiator, RAM disk and Virtual DVD drive.
2DegreesFrost [6], a Bellingham, WA software company has shipped a driver for Mac OS X (10.4) providing AoE support.
Hardware support
The Coraid [7] company offers an ATA over Ethernet hard disk called EtherDrive.
Also the vblade program makes it possible to export hard disks using inexpensive computers running Linux. Two independent implementations of vblade exist: A userspace one (part of aoetools package) and another one implemented as a linux kernel module.
Related Concepts
Although AoE is a simple network protocol, it opens up a complex realm of storage possibilities. To understand and evaluate these storage scenarios, it helps to be familiar with a few concepts.
Block Storage
The ATA in "ATA over Ethernet" is a kind of wire protocol for disk drives. Data is written
to the disk and read back from it in one or more fixed-size chunks of data called blocks.
The ATA over Ethernet protocol simply puts ATA commands into low-level network packets, so that an Ethernet network effectively replaces the cable that goes to the disk drive. Just as blocks of data can go to a disk drive through a ribbon cable in a computer, they can also go over ethernet cables.
The ribbon cable doesn't care what is inside of the blocks of data, and neither does AoE. You can read and write any blocks of data you want, but most of the time, a file system is used to organize the data.
Filesystems on block storage
Traditionally, a filesystem has been used on a computer that is the sole user of its hard disk. Filesystems like ext3, XFS, HFS+, and NTFS were designed with this assumption in mind.
When you use AoE, using an Ethernet network in the place of a cable, it's possible to violate that assumption. For traditional
filesystems, that is a dangerous thing to do, leading to filesystem corruption or kernel panics.
Cluster filesystems avoid the assumption that only one computer has access to the block device. They are designed to allow multiple members of a cluster of computers to use a shared block device safely, by coordinating their actions.
Examples of cluster filesystems are GFS and OCFS2.
SANs (Storage Area Networks) File Systems are another means to avoid this problem. MetaSAN is a SAN software package that supports AoE. It is produced by a European software company, Tiger Technology Sarl [8].
Disk Drives
The AoE target is a hard disk, or something that appears to be a hard disk. A few key points regarding hard disks are:
★ Access speed is dependent upon disk RPM (rotational latency), head movement speed (seek time), magnetic density, accuracy of head alignment on the track, data location on disk, and interface electronics;
★ Random disk access speed is entirely dominated by seek time;
★
★ Random access is over 100 times slower than sequential access[9];
★
★ Single disk sequential access is typically 50-80 MB/s;
★
★ RAID generally improves sequential and random access performance;
★
★ Host OS and disk filesystem try to store data sequentially to help the disk perform (McKusick 1984).
Ethernet
The wikipedia article on Ethernet networks has more information,
but for AoE it is helpful to keep in mind the points listed below.
★ AoE packets use MAC addresses to indicate the source and destination. MAC addresses are the Ethernet-level addresses that are required for ethernet to work. A MAC address only works inside a single ethernet broadcast domain.
★ Current Ethernet hardware features include flow control, which helps to minimize the need for packet retransmission.
★ Ethernet uses Cyclic redundancy checks to ensure that packets arrive intact.
Network Storage
When using an Ethernet network to access block storage, there are several potential advantages:
★ It is easier to add storage capacity.
★ The amount of storage is practically unlimited.
★ Access can be controlled by creating ad hoc ethernet networks.
★ Common commodity hardware can be used.
★ Data backup may be easier.
★ Data may be shared instead of being confined to one computer.
Config String
The AoE protocol provides a mechanism for host-based cooperative
locking. When more than one AoE initiator is using an AoE target,
they must cooperate. The hosts need a way to avoid interfering with
one another as they use and modify the data on the shared AoE device.
The hosts can simply communicate, using, for example, TCP/IP to send messages to one another. Through
communication, the hosts can agree which host has the right to access
particular blocks on the shared storage.
Another option is to use the storage device itself as the mechanism
for determining the access of particular hosts. The AoE protocol
includes a "config string" feature. If more than one host tries to
set the config string, only one actually succeeds. The other host
receives an error. At that point, the "winner" is decided and the
winner can proceed to establish an access policy.
See also
★ HyperSCSI
★ iSCSI
External links
★ Articles:
★
★ ATA Over Ethernet: Putting Hard Drives on the LAN — Linux Journal (28 April 2005)
★
★ ATA-over-Ethernet enables low-cost Linux-oriented SAN — LinuxDevices.com (23 June 2004)
★
★ The ATA over Ethernet (AoE) Protocol — Linux Magazine (June 15th, 2005)
★ Protocol:
★
★ AoE protocol description (PDF file)
★
★ AoE protocol specification
★ Emulator and Tools:
★
★ ATA Over Ethernet Tools and vblade vblade is an AoE target that runs in userspace, and kvblade is an alpha in-kernel AoE target
★
★ vblade, implemented as a kernel module this is faster than the userspace vblade
★
★ qaoed - Mulithreaded ATA over Ethernet storage target Runs in userspace
★
★ Aoeserver - Mulithreaded ATA over Ethernet storage target Implemented as a kernel module
★ Live CD:
★
★ Slax Frodo with vblade and ATA Over Ethernet Tools this is useful for testing and backup
References
★ .
★
This article provided by Wikipedia. To edit the contents of this article, click here for original source.
psst.. try this: add to faves

العربية
中国
Français
Deutsch
Ελληνική
हिन्दी
Italiano
日本語
Português
Русский
Español