HPE Ezmeral Data Fabric ToolBox Project

This project is a Flask web application for the HPE Ezmeral Data Fabric ToolBox. The application supports various functionalities such as FQDN setup, cleanup operations, and log collection.

Getting Started

This section describes the steps required to run the project on your local machine.

Prerequisites

• Python 3.x
• Flask

Installation

1. Clone the project:

   git clone [repo_link]

2. Install the required packages:

   pip install -r requirements.txt

3. Run the application:

   python flask_app.py

API Endpoints

The application provides a series of API endpoints to support various functionalities:

• /fqdn: Main page for FQDN setup.
• /cleanup: Main page for cleanup operations.
• /log_collection: Main page for log collection operations.
• ... [Refer to the code for other endpoints]

Logger

The application includes a customized logger capable of logging to both file and stdout. The logger is initiated with a variable named global_logger and is used throughout the application.

Contributing

If you wish to contribute to this project, please first create an issue to discuss the changes you wish to make.

License

This project is licensed under the [CUSTOM LICENSE] - see the LICENSE file for more details.

Acknowledgments

Thanks to everyone who contributed to this project!

Ubuntu 18.04-20.04 Installation on HPE Datafabric

General Reference for Data Fabric Customer Documents: https://docs.ezmeral.hpe.com/

Minimum Requirements

Storage

• /: 50 Gb - 275 Gb
• /var: 150 Gb - 175 Gb
• /srv: 100 Gb - 150 Gb
• /opt: 128 Gb - 150 Gb
• swap: 30 Gb
• No-Formatted: 100 Gb - 120 Gb

Resource Requirements

• Memory: 65 Gb - 100 Gb
• CPU: 16 Core

Technical Requirements

User Passwordless Sudo

sudo nano /etc/sudoers
mapr
ALL=(ALL:ALL) NOPASSWD:ALL

Local Configuration

sudo nano /etc/apt/sources.list

Install Software from Repo

sudo apt install openssh-server neofetch htop net-tools -y

Disable Auto Updates

sudo nano /etc/apt/apt.conf.d/20auto-upgrades
APT::Periodic::Update-Package-Lists "0";
APT::Periodic::Download-Upgradeable-Packages "0";
APT::Periodic::AutocleanInterval "0";
APT::Periodic::Unattended-Upgrade "1";

Swap Priority Change

sudo swapoff -a
sudo nano /etc/fstab

Swappiness Change

sudo nano /etc/sysctl.conf
vm.swappiness = 55
sudo sysctl --load

Add Neofetch and IP Command

sudo nano ~/.bashrc
neofetch
ifconfig | grep "inet 10.34.2.*\n"

Install Docker

Set Root Password and SSH Configuration

sudo passwd root
sudo nano /etc/ssh/sshd_config
PermitRootLogin yes
PasswordAuthentication yes
ChallengeResponseAuthentication no
sudo systemctl restart sshd
ssh root@localhost

Change UID and GID of User to 5000

ssh root@localhost
usermod -u 5000 mapr
groupmod -g 5000 mapr

Or Add New User with Specific UID-GID

useradd -m -u $MAPR_UID -g $MAPR_GID -G $(stat -c '%G' /etc/shadow) $MAPR_USER
MAPR_USER defaults to mapr.
MAPR_UID defaults to 5000.
MAPR_GID defaults to 5000.

Install Cloud-Init

Mapr-Setup Installation Steps

1. sudo chmod u+s /sbin/unix_chkpwd

2. sudo apt install openjdk-11-jre openjdk-11-jre-headless

3. Download the Mapr-Setup script:

   wget --user=<user> --password=<password> https://package.ezmeral.hpe.com/releases/installer/mapr-setup.sh
   chmod +x mapr-setup.sh

   1. Don’t forget to delete the “-T” value for the wget command in the mapr-setup.sh script.

   2. Execute the setup:

      sudo ./mapr-setup.sh -r https://<user>:<password>@package.ezmeral.hpe.com/releases/

4. For every Node, you need to add the public key of the apt repository:

   wget --user <user> --password <password> https://package.ezmeral.hpe.com/releases/installer/ubuntu/pub/maprgpg.key
   sudo apt-key add maprgpg.key

   1. Access the installer at https://<Installer Node hostname/IPaddress>:9443.

5. More details of the mapr-setup script can be found here.

6. For License search Data Fabric Community Edition, visit this link.

7. For the Installer Troubleshooting, refer to this guide.