iconm-menu
English chevron-down
中文EnglishРусский
moon-outline
light

Build a BiSheng JDK RPM Package

Benshuai5D2021-06-06BiSheng JDKbuild RPM package

Start from Scratch: Building a BiSheng JDK RPM Package (on openEuler and Raspberry Pi)

BiSheng JDK is the open source version of Huawei JDK customized for Huawei internal OpenJDK. It is a high-performance OpenJDK distribution that can be used in production environments. Huawei JDK runs on more than 500 Huawei products, and its development team has accumulated rich development experience, resolved countless issues encountered in actual service running, and improved the JDK performance on the ARM architecture. Therefore, BiSheng JDK can achieve better performance in big data scenarios.

Red Hat Package Manager (RPM) is a software package management system running on Red Hat Enterprise Linux, CentOS, and Fedora. It can easily distribute, manage, and update software created for Red Hat Enterprise Linux, CentOS, and Fedora. Packaging software into RPM packages includes: (re)installing, deleting, upgrading, and verifying the software packages; packaging original software sources into source and binary packages; adding the software packages to Yum repositories; and signing digital signatures.

This document analyzes the RPM package build process of OpenJDK-1.8.0 on a VM and on a Raspberry Pi, both with openEuler installed.

Build Process of openEuler-based BiSheng JDK RPM Packages

1. openEuler Installation

Downloading the openEuler Image File

openEuler, an open source OS, is designed based on the Linux kernel and developed by global open source contributors. It supports Kunpeng and other processors and can fully unleash the potential of computing chips. It has become essential for database, big data, cloud computing, and artificial intelligence (AI) scenarios. In addition, openEuler provides entry to the open source OS community, where global developers can collaborate to build an innovative, unified, and open OS that supports the multi-processor architecture, to advance the hardware/software applications.

Visit the official openEuler website and download the required version. In this example, select openEuler 20.03 LTS. openEuler 20.03 LTS is a standard distribution, whose lifecycle is four years. It meets the requirements of open solutions.

image-openEuler-version

Click Download on the card of the selected version. On the Download page, select ISO/ to download the image CD-ROM file. You can use the burning software to directly burn the ISO file into a system CD-ROM that can be installed. The ISO file name extension is .iso.

image-openEuler-20.03-LTS

In the ISO/ index, select the system to be downloaded. The ISO download list of openEuler 20.03 LTS provides the AArch64 ISO, x86_64 ISO, and openEuler source code ISO. Here, we use the x86_64 ISO.

image-openEuler-ISO

In the /openEuler-20.3-LTS/ISO/x86_64/ index, download the required ISO file. Here, we download openEuler-20.03-LTS-x86_64-dvd.iso.

image-openEuler-x86_64

Creating a VM

Use the VMware Workstation or Oracle VM software to create a VM, with the downloaded ISO image file openEuler-20.03-LTS-x86_64-dvd.iso.

On the openEuler INSTALLATION SUMMARY page, set the installation parameters, such as the Keyboard, Language Support, Time & Date, and Installation Destination.

image-INSTALLATION SUMMARY

On the INSTALLATION SUMMARY page, select Installation Destination and set the installation disk and partition of the OS.

image-INSTALLATION Destination

Set the password for the root user of the VM. A root account is used to run administration tasks of key systems. It is not recommended during daily work or system access.

image-CONFIGURATIONimage-reroot

Creating a User Account

useradd zhangsan   // Create an individual user account.
passwd zhangsan    // Change the personal password.
su - zhangsan      // Switch to the individual user account.
image-newuser

The password of the root user and the password of the new user must meet the password complexity requirements; otherwise, the password configuration or user creation will fail. Password complexity requirements: Each password must contain at least eight characters, including at least three types of the following characters: uppercase letters, lowercase letters, digits, and special characters.
Note: The password cannot be the same as the account and cannot be a password in the weak password dictionary.

MobaXterm: Remote Network Access Tool

MobaXterm is a toolbox for remote computing. Its intuitive user interface allows you to access remote servers through different networks or systems. After a VM is created and configured, you can access it using MobaXterm. The IP address of the VM is allocated after the VM is created.

image-MobaXterm

Remotely access the openEuler VM using the corresponding IP address, username, and password.

image-MobaXterm-SSH

2. Dependency Installation and Source File Download

Installing the RPM Build Toolkit

yum install rpm-build rpm-devel rpmdevtools

image-rpmbuildtools

Check the utilities for RPM packaging provided by the software package: rpm -ql rpmdevtools | grep bin rpm -ql rpm-devel | grep bin rpm -ql rpm-build | grep bin

image-rpm -ql rpm-devel

rpmdev-setuptree creates the directory layout for constructing the RPM packaging space.
rpmdev-newspec creates an empty SPEC file.
rpmbuild creates an actual RPM software package from the SPEC file.
rpmspec queries the parsed output of specifications.

Go to the personal folder and run rpmdev-setuptree to automatically create the rpmbuild directory and related subdirectories.

image-rpmdev-setuptree

The following figure shows the generated rpmbuild directory and its subdirectories.
BUILD: During package build, %buildroot creates various directories here. If the log output does not provide sufficient information, it is useful to investigate failed builds.
RPMS: Binary RPMs are created in its subdirectories of different architectures (for example, x86_64 and noarch).
SOURCES: This folder stores the compressed source code archives and patches. The rpmbuild command can be found here.
SPECS: This folder stores SPECS files.
SRPMS: If rpmbuild is used to build SRPM instead of binary RPM, the result SRPM is created here.

image-rpmdev-setuptree-filelist

Preparing the Source Package and SPEC File

In the /rpmbuild/SOURCES/ directory, download the jdkSource file for building the RPM package by running git clone https://gitee.com/src-openeuler/openjdk-1.8.0.git. The URL of the openJDK is https://gitee.com/src-openeuler/openjdk-1.8.0. If you want to build the JDK of another version, replace the URL.

.image-git clone jdk source

Move the SPEC file in the downloaded JDK package to the SPECS folder.
mv ./openjdk-1.8.0/*spec ../SPECS/

image-spec-preapareimage-spec-preaparelist

Move other files in the JDK package to the SOURCE folder.
mv ./openjdk-1.8.0/* ./

image-source-prepareimage-source-preparelist

Installing and Configuring JDK 8

You can use yum list | grep openjdk to check the JDK version that can be installed in the Yum source of openEuler and install the JDK. If the required JDK is not available, install it or update the Yum source.

image-yum list grep openjdk

Installation command: yum install java-1.8.0-openjdk.x86_64

Check whether the JDK is installed successfully.
java -version

image-java -version

The following lists the versions provided by each OpenJDK Yum source.

https://repo.openeuler.org/openEuler-20.03-LTS/OS/x86_64/Packages/

image-openEuler-21.03-os

https://repo.openeuler.org/openEuler-20.03-LTS/everything/x86_64/Packages/

image-openEuler-everything

https://repo.openeuler.org/openEuler-21.03/everything/x86_64/Packages/

image-openEuler-everything-jdk11

Installing the Dependencies

yum install alsa-lib-devel cups-devel elfutils-devel fontconfig-devel freetype-devel giflib-devel harfbuzz-devel lcms2-devel nss-devel

image-reliant package

To install other required dependencies, run the yum install package command.

3. RPM Package Build

Go to the SPECS folder and enter the corresponding command as required to start the build.

rpmbuild -bi java-1.8.0-openjdk.spec // Execute script in the install phase.   
rpmbuild -bb java-1.8.0-openjdk.spec // Generate the RPM binary package.  
rpmbuild -bs java-1.8.0-openjdk.spec // Generate the RPM source package.  
rpmbuild -ba java-1.8.0-openjdk.spec // Generate the RPM binary package and source package.

The RPM package build complete.

image-successful result

File list

tree

4. Common Errors and Solutions

Error: There are no enabled repositories in "/etc/yum.repos.d"

image-there are no enabled repositories

Solution:

cd /etc/yum.repos.d

vi openEuler_x86_64.repo (or vi openEuler_aarch64.repo for AArch64 OSs)

Content to be added:

#generic-repos is licensed under the Mulan PSL v2.
#You can use this software according to the terms and conditions of the Mulan PSL v2.
#You may obtain a copy of Mulan PSL v2 at:
#    http://license.coscl.org.cn/MulanPSL2
#THIS SOFTWARE IS PROVIDED ON AN "AS IS" BASIS, WITHOUT WARRANTIES OF ANY KIND, EITHER EXPRESS OR
#IMPLIED, INCLUDING BUT NOT LIMITED TO NON-INFRINGEMENT, MERCHANTABILITY OR FIT FOR A PARTICULAR
#PURPOSE.
#See the Mulan PSL v2 for more details.

[OS]
name=OS
baseurl=http://repo.openeuler.org/openEuler-20.03-LTS/OS/$basearch/
enabled=1
gpgcheck=1
gpgkey=http://repo.openeuler.org/openEuler-20.03-LTS/OS/$basearch/RPM-GPG-KEY-openEuler

[everything]
name=everything
baseurl=http://repo.openeuler.org/openEuler-20.03-LTS/everything/$basearch/
enabled=1
gpgcheck=1
gpgkey=http://repo.openeuler.org/openEuler-20.03-LTS/everything/$basearch/RPM-GPG-KEY-openEuler

[EPOL]
name=EPOL
baseurl=http://repo.openeuler.org/openEuler-20.03-LTS/EPOL/$basearch/
enabled=1
gpgcheck=1
gpgkey=http://repo.openeuler.org/openEuler-20.03-LTS/OS/$basearch/RPM-GPG-KEY-openEuler

[debuginfo]
name=debuginfo
baseurl=http://repo.openeuler.org/openEuler-20.03-LTS/debuginfo/$basearch/
enabled=1
gpgcheck=1
gpgkey=http://repo.openeuler.org/openEuler-20.03-LTS/debuginfo/$basearch/RPM-GPG-KEY-openEuler

[source]
name=source
baseurl=http://repo.openeuler.org/openEuler-20.03-LTS/source/
enabled=1
gpgcheck=1
gpgkey=http://repo.openeuler.org/openEuler-20.03-LTS/source/RPM-GPG-KEY-openEuler

[update]
name=update
baseurl=http://repo.openeuler.org/openEuler-20.03-LTS/update/$basearch/
enabled=1
gpgcheck=1
gpgkey=http://repo.openeuler.org/openEuler-20.03-LTS/OS/$basearch/RPM-GPG-KEY-openEuler

The Yum source is from Gitee. The link is https://gitee.com/src-openeuler/openEuler-repos/blob/openEuler-20.03-LTS/generic.repo#.

Error: Failed build dependencies: packages is needed by java-1.8.0-openjdk-1:1.8.0.282.b08-17.x86_64

image-packages is needed by java-1.8.0-openjdk

Cause: Packages required for RPM package build are not installed in the SPECS file.

Solution: Run the yum install packages command to install the packages.

yum install gdb java-1.8.0-openjdk-devel libX11-devel libXext-devel libXi-devel libXinerama-devel libXrender-devel libXt-devel libXtst-devel libjpeg-devel openssl-devel

image-yum install packages

Error: java-8-openjdk-devel is is needed by xxx

Cause: openjdk-devel is required in BuildRequires in the SPEC file, but the current OpenJDK version does not meet the requirement.

Solution: If you are sure that the installed OpenJDK version meets the build requirements, comment out the line or modify the version requirements. If you are not sure whether the current version meets the build requirements, install and configure the OpenJDK version as required.

image-java-8-openjdk-devel is needed by xxx

Error :tzdate-java>=2020a is needed by xxx

Cause: The tzdate-java version is specified in BuildRequires in the SPEC file, but the installed version does not meet the requirement.

Solution: If you are sure that the installed tzdate-java version meets the build requirements, comment out the line or modify the version requirements. If you are not sure whether the current version meets the build requirements, install and configure the tzdate-java version as required.

image-tzdate-java

Error: Bad exit status from /var/tmp/rpm-tem.f4PLQX(%build)

Cause: JDK 8 has been configured in the system, but the downloaded SPEC file has not been modified. You need to access the SPEC file and change the JDK path to the local JDK 8 path.

vim /root/rpmbuild/SPECS/java-1.8.0-openjdk.spec?configure

Find the configure location and change the JDK path to the local JDK 8 path.

image-Bad exit status from

5. RPM Package Build for Other JDK Versions

For other JDK versions, such as JDK 11 and JDK 15, if you want to build RPM packages, you only need to download the JDK source package of the corresponding version, replace the corresponding URL, and change the JDK path to the corresponding local JDK path. The build process is the same as that of JDK 8. If an error message is displayed, refer to solutions provided in this section.

Build Process of openEuler-based Raspberry Pi RPM Packages

1. Installation of the openEuler ISO Image

Installation Requirements

The Raspberry Pi where you want to install the openEuler OS must meet the following hardware compatibility and minimum hardware requirements: Raspberry Pi versions 3B, 3B+, and 4B; Memory: at least 4 GB for better application experience; Drive: at least 8 GB for better application experience. The Raspberry Pi official website is https://www.raspberrypi.org/, and the openEuler community website is https://www.openeuler.org/en/download/.

Obtaining the Installation Source

Obtain the Raspberry Pi image and its verification file released by openEuler. Log in to the openEuler community and click Download on the openEuler 20.03 LTS SP1 card.

image-get iso

Click raspi_img. The Raspberry Pi image download list is displayed.

image-get rasp_img

Click openEuler-20.03-LTS-SP1-raspi-aarch64.img.xz to download the Raspberry Pi image released by openEuler to your local PC.

image-get img

Formatting the SD Card

Download and install an SD card formatting tool. The following uses the DiskGenius disk formatting tool as an example.

Select the drive letter of the SD card to be formatted, delete its content, and save the file.

Select the disk whose content has just been deleted, create a partition, set the file system type to FAT32, and save and format the disk.

Writing the Image File to the SD Card

Download and install an image writing tool. The following uses Win32 Disk Imager as an example.

Select the openEuler-20.03-LTS-SP1-raspi-aarch64.img image file in the image file download path, select the drive letter of the SD card as the device, and click Write.

Note: After the image file is written, the disk capacity of the SD card decreases because the ext file system cannot be identified in Windows. This is normal.

Starting the System

Insert the SD card after image writing into the Raspberry Pi and power it on.

Logging In to the System

You can log in to the Raspberry Pi in either of the following ways: local login and SSH remote login.

Local login: After the Raspberry Pi is connected with the monitor, keyboard, and mouse, start the Raspberry Pi and you can view the Raspberry Pi startup logs on the monitor. After the Raspberry Pi is started, enter the username (root) and password (openeuler) to log in.

SSH remote login: If the Raspberry Pi is connected to a known router, you can log in to the router to view the new IP address (that is, the Raspberry Pi IP address). Alternatively, you can use an IP address scanning tool to scan the Raspberry Pi IP address. The following uses advanced_ip_scanner as an example.

image-log in system

For example, if the IP address of the Raspberry Pi is 192.168.1.9, you can use the remote network access tool MobaXterm to access the Raspberry Pi.

image-use the moba log

If the remote access is successful, enter the username (root) and password (openeuler) to log in. The following figure shows the window for using MobaXterm to access the openEuler system on the Raspberry Pi.

image-the success of log

2. Installing Yum on Raspberry Pi openEuler

Log in to the system and run yum to install packages and dependencies. The message -bash: yum: command not found is displayed.

image-yum command not found

You need to manually install yum-4.2.23-3.oe1.noarch.rpm and upload it.

URL: https://repo.openeuler.org/openEuler-20.03-LTS-SP1/everything/aarch64/Packages/yum-4.2.23-3.oe1.noarch.rpm. Run rpm -ivh --force --nodeps yum-4.2.23-3.oe1.noarch.rpm in the same directory.

image-yum rpm

3. Dependency Installation and Source File Download

Installing the RPM Build Toolkit

yum install rpm-build rpm-devel rpmdevtools

image-rpmbuildtools

Go to the personal folder and run rpmdev-setuptree to automatically create the rpmbuild directory and related subdirectories.

image-repdev-setuptree

The following figure shows the generated rpmbuild directory and its subdirectories.
BUILD: During package build, %buildroot creates various directories here. If the log output does not provide sufficient information, it is useful to investigate failed builds.
RPMS: Binary RPMs are created in its subdirectories of different architectures (for example, x86_64 and noarch).
SOURCES: This folder stores the compressed source code archives and patches. The rpmbuild command can be found here.
SPECS: This folder stores SPECS files.
SRPMS: If rpmbuild is used to build SRPM instead of binary RPM, the result SRPM is created here.

image-success of setuptree

Preparing the Source Package and SPEC File

In the /rpmbuild/SOURCES/ directory, download the jdkSource file for building the RPM package by running git clone https://gitee.com/src-openeuler/openjdk-1.8.0.git. The URL of the openJDK is https://gitee.com/src-openeuler/openjdk-1.8.0. If you want to build the JDK of another version, replace the URL.

image-prepare the src package

Move the SPEC file in the downloaded JDK package to the SPECS folder.
mv ./openjdk-1.8.0/*spec ../SPECS/

image-the first of commandimage-the result of move the spec

Move other files in the JDK package to the SOURCE folder.
mv ./openjdk-1.8.0/* ./

image-the result of move the everything

Installing and Configuring JDK 8

You can use yum list | grep openjdk to check the JDK version that can be installed in the Yum source of openEuler and install the JDK. If the required JDK is not available, install it or update the Yum source.

yum openjdk rasp

Installation command: yum install java-1.8.0-openjdk.aarch64

Check whether the JDK is installed successfully.
java -version

Installing the Dependencies

yum install alsa-lib-devel cups-devel elfutils-devel fontconfig-devel freetype-devel giflib-devel harfbuzz-devel lcms2-devel

image-yum install reliant package

To install other required dependencies, run the yum install package command.

4. RPM Package Build

Go to the SPECS folder and enter the corresponding command as required to start the build.

rpmbuild -bi java-1.8.0-openjdk.spec Execute the script in the install phase.
rpmbuild -bb java-1.8.0-openjdk.spec Generate the RPM binary package.
rpmbuild -bs java-1.8.0-openjdk.spec Generate the RPM source package.
rpmbuild -ba java-1.8.0-openjdk.spec Generate the RPM binary package and source package.

The following figure shows a built RPM package.

raspberry success

The file list is as follows:

tree

5. Errors and Solutions

Error: The Raspberry Pi cannot be remotely accessed.

For the SSH connection, you need to: (1). Confirm that the Raspberry Pi is connected to the network. (2). Confirm that the IP address, username, and password are correct. (3). Check whether the SSH is enabled. If the Raspberry Pi is connected to the network and the IP address, username, and password are correct, but the remote access still fails, the SSH is disabled.

Solution: If an external monitor is used and the system monitor interface is connected, run the rpm -qa|grep openssh command to check whether the SSH server software package has been installed during system installation. If the command output contains openssh-server-, the SSH server has been installed. In this case, run the service iptables start command to start the SSHD service.

images-openssh

If no external monitor is available and the system monitor interface can be connected, create an SSH file (without the file name extension) in the SD card to enable remote access.

.image-ssh

Error: bash: yum: command not found

When you run the yum command, the message -bash: yum: command not found is displayed.

yum command not found

You need to manually install yum-4.2.23-3.oe1.noarch.rpm and upload it.

URL: https://repo.openeuler.org/openEuler-20.03-LTS-SP1/everything/aarch64/Packages/yum-4.2.23-3.oe1.noarch.rpm. Run rpm -ivh --force --nodeps yum-4.2.23-3.oe1.noarch.rpm in the same directory.

yum rpm

Error: Failed build dependencies: xxx is needed by java-1.8.0-openjdk-1:1.8.0.282.b08-17.aarch64

failed build dependencied

Cause: Packages required for RPM package build are not installed in the SPECS file.

Solution: Run the yum install xxx command to install the package.

yum install gdb java-1.8.0-openjdk-devel libX11-devel libXext-devel libXi-devel libXinerama-devel libXrender-devel libXt-devel libXtst-devel libjpeg-devel openssl-devel

Error: java-8-openjdk-devel is needed by xxx

Cause: openjdk-devel is required in BuildRequires in the SPEC file, but the current OpenJDK version does not meet the requirement.

Solution: If you are sure that the installed OpenJDK version meets the build requirements, comment out the line or modify the version requirements. If you are not sure whether the current version meets the build requirements, install and configure the required OpenJDK version.

image-java-8-openjdk-devel is needed by xxx

Error: Bad exit status from /var/tmp/rpm-tem.f4PLQX(%build)

Cause: JDK 8 has been configured in the system, but the downloaded SPEC file has not been modified. You need to access the SPEC file and change the JDK path to the local JDK 8 path.

vim /root/rpmbuild/SPECS/java-1.8.0-openjdk.spec?configure

Find the configure location and change the JDK path to the local JDK 8 path.

image-Bad exit status from

6. RPM Package Build for Other JDK Versions

For other JDK versions, such as JDK 11 and JDK 15, if you want to build RPM packages, you only need to download the JDK source package of the corresponding version, replace the corresponding URL, and change the JDK path to the corresponding local JDK path. The build process is the same as that of JDK 8. If an error message is displayed, refer to solutions provided in this section.

References

How to create an RPM package: https://fedoraproject.org/wiki/How_to_create_an_RPM_package?rd=How_to_create_an_RPM_package/en

RPM Packaging Guide: https://rpm-packaging-guide.github.io/

BiSheng JDK 8 User Guide: https://gitee.com/openeuler/bishengjdk-8/wikis/Home?sort_id=2879418

Raspberry Pi: https://www.raspberrypi.org/


[Disclaimer] This article only represents the author's opinions, and is irrelevant to this website. This website is neutral in terms of the statements and opinions in this article, and does not provide any express or implied warranty of accuracy, reliability, or completeness of the contents contained therein. This article is for readers' reference only, and all legal responsibilities arising therefrom are borne by the reader himself.