Patrick

HP / HPE Moonshot Unofficial Reference Guide

Patrick

Administrator
Staff member
Dec 21, 2010
11,965
4,924
113
Patrick submitted a new resource:

HP / HPE Moonshot Unofficial Reference Guide - Creating a tome of knowledge with all you need to know on the Moonshot

Similar to what we have for the Dell PowerEdge C6100 and Dell PowerEdge C6220, starting a reference list for the HP / HPE Moonshot. These are fairly complex modular systems so here is a list of parts. Please do share if you find more information/ items not listed.

Cartridges
(See reference here)
  • ProLiant m300 - Single Atom C2750 with 4x SODIMM slots, 1GbE NIC, SATA 2.5" and m.2 storage
  • ProLiant m350...
Read more about this resource...
 
  • Like
Reactions: William and b3nz0n8

b3nz0n8

Member
Feb 18, 2013
71
50
18
Hewlett Packard Enterprise Information Library

Source (PDF attached): Products & Solutions>HP Moonshot

Getting Started (15)

HP Moonshot System Setup Overview HTML 24 KB Jun 2014
HP Moonshot System Site Planning Guide PDF 823 KB Dec 2014
Important Information - Assign the Original Cartridge Properties to the Replacement Cartridge to Ensure Warranty Entitlement PDF 209 KB Apr 2013
HP Insight Cluster Management Utility v7.3.2 Release Notes PDF 386 KB Apr 2015
HP Insight CMU v7.3 Release Notes PDF 368 KB Sep 2014
HP Moonshot Family Data Sheet PDF 390 KB May 2013
HP Moonshot System QuickSpecs PDF 2.8 MB May 2013
HP Moonshot System QuickSpecs HTML May 2013
HP ConvergedSystem 100 for Hosted Desktops Getting Started Guide PDF 8240 KB Jul 2014
HP Moonshot for Citrix Integration Guide PDF 6 MB Feb 2016
HP MOONSHOT-45XGc E2418 Release Notes PDF 1 MB Sep 2015
HP MOONSHOT-45XGC-CMW710-R2417 Release Notes PDF 519 KB Apr 2015
Configuring VLANs on the HP Moonshot System - Quick Setup Instructions PDF 103 KB Jun 2013
HP Moonshot Networking Cookbook, 7th edition PDF 2 MB Sep 2015
HP Moonshot Provisioning Manager Release Notes PDF 41.3 KB Apr 2016

Installation (4)

HP Moonshot 1500 Chassis Setup and Installation Guide PDF 2.4 MB Sep 2015
Quick Deploy Rail System Installation Instructions PDF 2.0 MB Jun 2014
HP Moonshot Switch Module Installation Instructions PDF 300 KB Mar 2015
HP Moonshot Uplink Module Installation Instructions PDF 300 KB Mar 2015
 

Attachments

Last edited:
  • Like
Reactions: Patrick

b3nz0n8

Member
Feb 18, 2013
71
50
18
Service & Maintenance (10)

HP Moonshot Troubleshooting Guide PDF 641 KB Dec 2013
HP Moonshot 1500 Chassis Maintenance and Service Guide PDF 4.1 MB Apr 2015
Removing the Fan from the HP Moonshot 1500 Chassis HTML 729 KB Dec 2013
Removing the Power Supply from the HP Moonshot 1500 Chassis HTML 494 KB Dec 2013
Removing the HP Moonshot 1500 iLO Chassis Management Module from the HP Moonshot 1500 Chassis HTML 633 KB Dec 2013
Removing the Uplink Module from the HP Moonshot 1500 Chassis HTML 624 KB Dec 2013
Removing the Cartridge from the HP Moonshot 1500 Chassis HTML 796 KB Dec 2013
Removing the Switch Module from the HP Moonshot 1500 Chassis HTML 559 KB Dec 2013
Removing the Midplane Assembly from the HP Moonshot 1500 Chassis HTML 3.23 MB Dec 2013
Removing the Backplane Assembly from the HP Moonshot 1500 Chassis HTML 2.10 MB Dec 2013

User Guides (26)

HP UEFI System Utilities User Guide for HP ProLiant m400 Server Cartridges PDF Aug 2015
HP UEFI Shell User Guide for HP ProLiant m400 Server Cartridges PDF Aug 2015
HP Advanced Power Manager User Guide PDF 1.9 MB Apr 2015
HP Moonshot iLO Chassis Management CLI User Guide PDF 2.7 MB Nov 2015
HP Moonshot iLO Chassis Manager Web Interface User Guide PDF 2.3 MB Nov 2015
Operating System Deployment on HP ProLiant Moonshot Server Cartridges User Guide PDF 28.8 KB Nov 2015
HP Moonshot Integration with Microsoft System Center PDF 15.9 KB Nov 2015
HP ProLiant m350 Server Cartridge User and Maintenance Guide PDF 1.0 MB Sep 2014
HP ProLiant m300 Server Cartridge User and Maintenance Guide PDF 1.0 MB Dec 2013
HP Moonshot Remote Console Administrator User and Maintenance Guide PDF 1.0 MB Sep 2015
HP Moonshot 1500 Chassis Label PDF 3.7 MB Dec 2013
HP Moonshot Component Pack Update Guide PDF 544 KB Nov 2015
HP Insight Cluster Management Utility v7.3.2 User Guide PDF 8 MB Apr 2015
HP Insight CMU v7.3 User Guide PDF 7.94 MB Sep 2014
HP ProLiant SL Advanced Power Manager User Guide PDF Jul 2013
HP Moonshot-45G/180G Switch User and Maintenance Guide PDF 1.5 MB Dec 2013
HP Moonshot-45XGc Switch User and Maintenance Guide PDF 2.5 MB Sep 2014
HP ProLiant m700 Server Cartridge User and Maintenance Guide PDF 935 KB Dec 2013
HP iLO Chassis Management IPMI User Guide PDF 2.1 MB Nov 2015
HP RESTful API Data Model Reference for Moonshot Chassis Manager HTML 1 MB Nov 2015
HP ProLiant Moonshot Server User and Maintenance Guide PDF 995 KB Apr 2013
HP ProLiant m710 Server Cartridge User and Maintenance Guide PDF 1.1 MB Dec 2014
HPE ProLiant m710p Server Cartridge User and Maintenance Guide PDF 2.27 MB Dec 2015
HP ProLiant m800 Server Cartridge User and Maintenance Guide PDF 2.0 MB Oct 2014
HP ProLiant m400 Server Cartridge User and Maintenance Guide PDF 1.0 MB Oct 2014
HP Moonshot Provisiong Manager User Guide HTML 52.7 KB Apr 2016
 
  • Like
Reactions: dba and Patrick

b3nz0n8

Member
Feb 18, 2013
71
50
18
Videos (23)

Introducing HP Moonshot HTML Jun 2013
Meet the Innovators HTML Jun 2013
HP Moonshot Discovery Lab HTML Jun 2013
HP Pathfinder Innovation Ecosystem HTML Apr 2013
HP Moonshot Chassis - Remove/Replace Videos HTML Jul 2013
HP Customer Self Repair Services Media Library: HP Moonshot Chassis HTML Jul 2013
HP Moonshot Networking - Getting Started HTML
HP Moonshot Networking - System Internal and External Connectivity HTML
HP Moonshot Network Management - How to identify your Hardware and Firmware via the Chassis Manager HTML
HP Moonshot Network - Updating your Firmware HTML
HP Moonshot Network - Connecting to the Virtual Serial Port (VSP) HTML
HP Moonshot Network - Switch Families HTML
HP Moonshot Network - Adapters, Cables, and Splitters Overview HTML
HP Moonshot Network - Connectivity and Port Setup Overview HTML
HP Moonshot Network Loops HTML
HP Moonshot High Availability Switch LAGs HTML
HP Moonshot - Creating a PXE Server HTML
HP Moonshot - Modifying PXE for the HP Moonshot Console HTML
HP Moonshot - Spanning Tree Protocol (STP) - Overview HTML
HP Moonshot - VLAN Configurations HTML
HP Moonshot - Port Mirroring on a Switch HTML
HP Moonshot - High Availability - Stacking Switches HTML
HP Moonshot - Server Cartridge LAG Setup HTML

White Papers (19)

HP Moonshot: An Accelerator for Hyperscale Workloads PDF 564 KB May 2013
HP ProLiant Moonshot System with NGINX Plus: Workload characterization and performance analysis for Web serving solution PDF 1.8 MB Dec 2013
Deploying NGINX Plus on HP ProLiant Moonshot Server Cartridges: Reference architecture PDF 936 KB Dec 2013
High-efficiency virtualization solution for Web hosting; Best practices for deploying Parallels Containers on HP Moonshot System PDF 755 KB Jul 2014
Deploying Microsoft IIS 8 on HP ProLiant m300 Server Cartridges PDF 500 KB Feb 2014
HP ProLiant m300 Server Cartridge and Microsoft IIS 8: Workload characterization and performance analysis for Web-serving workloads PDF 5.64 MB Feb 2014
HP ProLiant m300 Server Cartridges with NGINX Plus: Workload characterization and performance analysis for Web serving PDF 6.2 MB Mar 2014
Deploying NGINX Plus on HP ProLiant m300 Server Cartridges: Reference architecture PDF 1.9 MB Mar 2014
HP Moonshot for MongoDB: Performance analysis of MongoDB on HP ProLiant m300 Server Cartridges PDF 356 KB Aug 2014
HP Moonshot with ProLiant m300 Server Cartridges: Web infrastructure in a box PDF 1.32 MB Oct 2014
Video processing on HP ProLiant m710 Server Cartridge and Vantrix Media Platform PDF 804 KB Oct 2014
Efficient deployment of virtual network functions on HP ProLiant m800 PDF 583 KB Oct 2014
Performance evaluation of mobile application delivery: HP Moonshot for Citrix XenApp PDF 3.24 MB Nov 2014
WikiBench performance using KVM-based virtualization on HP ProLiant m710 Server Cartridge PDF 885 KB Nov 2014
HP Big Data Reference Architecture: Overview PDF 834 KB Dec 2014
HP Big Data Reference Architecture: Hortonworks implementation PDF 1.83 MB Dec 2014
HP Big Data Reference Architecture: Cloudera implementation PDF 1.94 MB Dec 2014
DataStax Enterprise on HP Moonshot System with HP ProLiant m710 Server Cartridges PDF 855 KB Dec 2014
External storage solution for HP ProLiant Moonshot Servers via iSCSI PDF 6.53 MB Dec 2014
 
  • Like
Reactions: Patrick

b3nz0n8

Member
Feb 18, 2013
71
50
18
HP Project Moonshot

In the beginning, the first Moonshot offering was called the Redstone Development Server Platform.

What's at 0:13...
HP / HPE PONK ( source )

HPE-Moonshot-HPE-PONK-Dev-Kit-ServeTheHome-STH.png

"...the PONK is the pre-build environment designed to test the cartridges before they make their way into the main chassis. It's essentially a scavenged ML350e with a different motherboard that takes four cartridges and can be lent to customers to allow them to develop applications for Moonshot without having to buy a fully populated cartridge."

HPE-Moonshot-Storage-Cartridge-ServeTheHome-STH.png
HPE Moonshot Storage Cartridge

"...There are even storage cartridges that take two spinning disks or SSDs and support RAID functionality and a cartridge built for database memcaching."

HP-Moonshot-Storage-Cartridge-m800.png

re: "Also check out the red PCB cartridge around 1:24 or 1:25"


HP-ProLiant-m800-Server-Cartridge-4-ARM-Cortex-A15-Cores-ServeTheHome-STH.PNG

HP ProLiant m800 Server Cartridge with 4 ARM Cortex A15 cores and 4 K2H12 8-core DSP cores with 500 gigaflops of performance, 8Gigabyes of data
 

Attachments

Last edited:
  • Like
Reactions: Patrick

Patrick

Administrator
Staff member
Dec 21, 2010
11,965
4,924
113
@b3nz0n8 I feel like you have done some of this research already! Great info.

BTW in that video, it is a test rig called a PONK, that supports only a few Moonshot cartridges. I do not believe those are on sale. I do believe there are people on the STH forums who have had them at some point.

Also check out the red PCB cartridge around 1:24 or 1:25.
 
Last edited:
  • Like
Reactions: b3nz0n8

b3nz0n8

Member
Feb 18, 2013
71
50
18



Source: FPGAs Ride HP's Moonshot | EE Times

...The dual-Stratix IV SRC Saturn 1 (eighth-generation SRC board) from SRC Computers.

SRC hopes to fuel Moonshot sales with its $20,000 4U card (pictured above) that hosts two Altera Stratix IV 530 FPGAs. The company claims the 45W board delivers 100 times the performance of an x86 server while using one percent of its power. The board also hosts a four-core Intel Atom chip for housekeeping duties and supports multiple Gbit Ethernet links to the Moonshot backplane.

Its secret sauce is its Carte compiler that automatically turns users’ C-level code into FPGA-readable firmware, eliminating the need for often complex Verilog-level FPGA programming tools. The FPGA also lets users quickly change code as workloads shift.
 
Last edited:
  • Like
Reactions: Patrick

b3nz0n8

Member
Feb 18, 2013
71
50
18
HP-Moonshot-Console-Administrator-mRCA.jpg
PDF: HP ProLiant HP Moonshot Remote Console Administrator - 806843-B21

Form Factor:
  • HP Moonshot Remote Console Administrator a card that plugs into the HP Moonshot 1500 Chassis.
Remote Interfaces:
  • Keyboard, Video, Mouse, and Virtual Media for the connected node in the respective supported HP Moonshot ProLiant Server Cartridges*
*Supported Cartridges:
  • HP ProLiant m700 Server Cartridge
  • HP ProLiant m710 Server Cartridge
  • HP ProLiant m350 Server Cartridge
  • HP ProLiant m300 Server Cartridge

Physical Interfaces: x1 PCIE to 1 of 4 adjacent cartridge nodes
Storage: vMedia
Power: ~20W
Interfaces:
  • Cartridge power LED/button
  • Cartridge health LED
  • Cartridge UID LED/button
  • Cartridge link LED/button
Industry Standard Compliance: PXE Support PCIe 3.0
Firmware:HP iLO 4

HPE-Moonshot-Remote-Console-Administrator-(mRCA)-Placement-Tool-STH-ServeTheHome.PNG

Tool: HPE Moonshot Remote Console Administrator (mRCA) Placement Tool

  • This online tool identifies where to place the mRCA cartridge to link to a specific cartridge/node within the chassis.
HPE-Moonshot-Remote-Console-Administrator-(mRCA)-Placement-Tool-Matrix-STH-ServeTheHome.PNG

Device Mapping (Page 41): Network layout HP Moonshot-180G Switch Module and HP Moonshot 4QSFP+ Uplink Module are installed

HP-Moonshot-Device-Mapping-Layout-180G-Switch-Module-4QSFP+Uplink-Installed-Pg-41-ServeTheHome.PNG

Device Mapping (Page 40): Network layout HP Moonshot-45G Switch Module and HP Moonshot 6SFP+ Uplink Module are installed

HP-Moonshot-Device-Mapping-Layout-45G-Switch-Module-6SFP+Uplink-Installed-Pg-40-ServeTheHome.PNG

Device Mapping (Page 39): Network layout HP Moonshot-45XGc Switch Module and HP Moonshot 4QSFP+ Uplink Module are installed

HP-Moonshot-Device-Mapping-Layout-45XGc-Switch-Module-4QSFP+Uplink-Installed-Pg-39-ServeTheHome.PNG
 

Attachments

Last edited:
  • Like
Reactions: Patrick

b3nz0n8

Member
Feb 18, 2013
71
50
18





SOURCE: Nacsa Sandor @ www.Lazure2.wordpress.com
HP-Moonshot-Fabric-1.PNG HP-Moonshot-Radial-Fabric-2.PNG HP-Moonshot-Storage-Fabric-3.PNG HP-Moonshot-2D-Torus-Mesh-Fabric-and-Topologies-4.PNG
HP-Moonshot-Diagram.png


HP Moonshot Fabrics and Topology

Fabric:
(Source 1 , Source 2)
  • Radial Fabric
  • Storage Storage
  • 2D Torus Mesh Fabric

Highly flexible fabric (Source 3 @ 55% down page, Source 4 page 4)

Built into the HP Moonshot 1500 Chassis architecture are four separate and independent fabrics that support a range of current and future capabilities:

• Network fabric

• Storage fabric

• Management fabric

• Integrated cluster fabric​


Network fabric

The Network fabric provides the primary external communication path for the HP Moonshot 1500 Chassis.

For communication within the chassis, the network switch has four communication channels to each of the 45 servers. Each channel supports a 1-GbE or 10-GbE interface.Each HP Moonshot-45G Switch Module supports 6 channels of 10GbE interface to the HP Moonshot-6SFP network uplink modules located in the rear of the chassis.

Storage fabric

The Storage fabric provides dedicated SAS lanes between server and storage cartridges. We utilize HP Smart Storage firmware found in the ProLiant family of servers to enable multiple core to spindle ratios for specific solutions. A hard drive can be shared among multiple server cartridges to enable low cost boot, logging, or attached to a node to provide storage expansion.

The current HP Moonshot System configuration targets light scale-out applications. To provide the best operating environment for these applications, it includes HP ProLiant Moonshot Servers with a hard disk drive (HDD) as part of the server architecture. Shared storage is not an advantage for these environments. Future releases of the servers thattarget different solutions will take advantage of the storage fabric.

Management fabric

We utilize the Integrated Lights-Out (iLO) application-specific integrated circuit (ASIC) standard in the HP ProLiant family of servers to provide the innovative management features in the HP Moonshot System. To handle the range of extreme low energy processors we provide a device neutral approach to management, which can be easily consumed by data center operators to deploy at scale.

The Management fabric enables management of the HP Moonshot System components as one platform with a dedicated iLO network. Benefits of the management fabric include:

• The iLO Chassis Manager aggregates data to a common set of management interfaces.

• The HP Moonshot 1500 Chassis has a single Ethernet port gateway that is the single point of access for the Moonshot Chassis manager.

• Intelligent Platform Management Interface (IPMI) and Serial Console for each server

• True out-of-band firmware update services

• SL-APM Rack Management spans rack or multiple racks​


Integrated Cluster fabric

The Integrated Cluster fabric provides a high-speed interface among future server cartridge technologies that will benefit from high bandwidth node-to-node communication. North, south, east, and west lanes are provided between individual server cartridges.

The current HP ProLiant Moonshot Server targets light scale-out applications. These applications do not benefit from the node-to-node communications, so the Integrated Cluster fabric is not utilized. Future releases of the cartridges that target different workloads that require low latency interconnects will take advantage of the Integrated Cluster fabric.


Moonshot System network configurations


Moonshot System network switches and uplink modules provide resiliency and efficiency when configured as stand-alone or stackable networks. This feature allows you to connect up to nine Moonshot 1500 Chassis and then to your core network, eliminating the need for a top of rack (TOR) switch.

  • Dual switches provide traffic isolation or can be stacked
  • Rack level stacking simplifies management domain
  • Redundant switch configurations provide a more resilient infrastructure
  • Layer 2, Layer 3 Routing & QoS, Management (CLI, SNMP, SFLOW).
    No license keys
 
Last edited:
  • Like
Reactions: Patrick

b3nz0n8

Member
Feb 18, 2013
71
50
18
HP ConvergedSystem 100 for Hosted Desktops (CS100)

HP-Converged-System-100-for-Hosted-Desktops.png


Citrix PVS server

Leveraging-HP-Moonshot-with-HP-ConvergedSystem-100-for-Hosted-Citrix-PVS.png

The Citrix PVS server is a key technology for enabling Moonshot System HDI. Citrix PVS streams a complete OS and application image to desktops running in both virtual and physical environments. The vDisk image can be shared by many desktops, becoming a common read repository. Desktops can write to many different locations, including local disk, memory, or back to the PVS server; however, this is recommended for image maintenance only. Moonshot nodes do not have the local storage capacity to host a complete desktop, but do have enough fast storage to act as write cache. Reads from the Citrix PVS server are usually cached in memory and local read/write traffic is cached to iSSD, which results in good desktop disk performance. The following figure illustrates how to boot a cartridge with an OS image streaming from a Citrix PVS server.


HP Moonshot System HDI solution

Leveraging-HP-Moonshot-with-HP-ConvergedSystem-100-for-Hosted-Citrix.png


HP Moonshot 1500 chassis

The HP Moonshot 1500 chassis provides several shared functions that are leveraged by HDI solutions.

Shared power and cooling

The HP Moonshot 1500 chassis supports up to four 1500 W hot-plug power supplies for N+1 redundancy. The chassis supports five hot-plug fan modules, each containing two fans per module, for a total of ten. The HP Moonshot 1500 chassis also supports advanced power management using the SL-APM and HP power distribution for racks.

Shared management

The HP Moonshot 1500 chassis has an integrated management network that provides command line access to view status and control resources. The HDI solution comes with a set of PowerShell scripts to view desktop management and enable the integration of application management environments. For sample scripts, see HP Moonshot system HDI sample scripts in the Getting Started Guide (for a complete OS image before it is moved to the Citrix XenDesktop PVS server.

Shared networking

The HP Moonshot 1500 chassis can accommodate up to two hot-plug Ethernet switches. Most deployment models for HDI deploy with two switches. Each m700 node has two NICs. One NIC is connected to Switch A, and one NIC is connected to Switch B. This enables dual active/active teaming, failover support, and 2 GB of aggregate bandwidth. Each switch has 180 downlink ports, one for each node. This provides a total of 360 1 GB downlink ports.

Both switches have a corresponding uplink module, each with four 40 GB QSFP+ uplink ports. You can use these ports for switch stacking and uplinks to a ToR or network core switch.
 

Attachments

Last edited:
  • Like
Reactions: dba and Patrick

Patrick

Administrator
Staff member
Dec 21, 2010
11,965
4,924
113
Power Consumption
These numbers fluxuate a bit but recording what I am seeing on 208V power:
  • 15x m700 with all 60x nodes on: 827W
  • All 60 nodes off: 482W
  • All 60 nodes off and 1 switch powered up: 328W
  • All 60 nodes off and 0 switches powered up: 205W
  • 1 of 60 M700 nodes on and 1 switch: 329W
  • 2 of 60 M700 nodes on and 1 switch: 333W
  • 3 of 60 M700 nodes on and 1 switch: 337W
  • 4 of 60 M700 nodes on and 1 switch: 348W
  • 8 of 60 M700 nodes on and 1 switch: 393W
  • 12 of 60 M700 nodes on and 1 switch: 424W
 
  • Like
Reactions: dba and b3nz0n8

E0LrFV

New Member
May 19, 2016
1
2
3
50
Wow, this is a great resource. So much better than HPE's website.

Some details I didn't see here:

PonK: Power on Kit
It's an ML360 shell with support for four cartridges, two 1Gb switches an a chassis manager. Never offered for sale. Folks that have had them have said that HP really made a point of getting them back.

The dual 2.5" HDD cartridge appears in the earliest marketing materials, but was never productized.

HP 681677-B21 is an adapter for the SL4500 chassis. It packs 3 units in 13RU, and works with Moonshot.

The 180G switch supports 10Gb/s connections to cartridges, but doesn't have 1.8TB of internal throughput, so you can't light up all 180 ports at 10Gb/s concurrently. I'm not sure if 10Gb/s modes have been officially offered for that switch.
 

Attachments

  • Like
Reactions: b3nz0n8 and Patrick

wardtj

Member
Jan 23, 2015
88
28
18
43
HP Project Moonshot

In the beginning, the first Moonshot offering was called the Redstone Development Server Platform.

What's at 0:13...
HP / HPE PONK ( source )

View attachment 2497

"...the PONK is the pre-build environment designed to test the cartridges before they make their way into the main chassis. It's essentially a scavenged ML350e with a different motherboard that takes four cartridges and can be lent to customers to allow them to develop applications for Moonshot without having to buy a fully populated cartridge."

View attachment 2498
HPE Moonshot Storage Cartridge

"...There are even storage cartridges that take two spinning disks or SSDs and support RAID functionality and a cartridge built for database memcaching."

View attachment 2496

re: "Also check out the red PCB cartridge around 1:24 or 1:25"


View attachment 2492

HP ProLiant m800 Server Cartridge with 4 ARM Cortex A15 cores and 4 K2H12 8-core DSP cores with 500 gigaflops of performance, 8Gigabyes of data
Another good video....

 
  • Like
Reactions: b3nz0n8

Churchill

Admiral
Jan 6, 2016
788
185
43
The company I was working for was on the list to test this machines. Fully loaded monsters that would allows us to spin up a single Windows instance of our choice in a physical environment and then reload it after it finished processing a package. HP was very keen in seeing how fast we could spin up, shutdown, rebuild a machine and how many packages we could process in a day vs. vmware and virtual systems.

Unfortunately HP went with a larger partner to test , we went with Dell blades, and now we can pick these servers up for dirt cheap.
 
  • Like
Reactions: b3nz0n8