Grant Zhou, head of Highgo North America Research Institute, delivered the technical explanation of IvorySQL project at the meeting on May 26, 2022 Ottawa time.
This conference mainly introduces who we are, what IvorySQL is, IvorySQL key function points, community contribution guide, developer guide, etc. Based on PostgreSQL 14, IvorySQL adds some exciting features on top of PostgreSQL!
IvorySQL provides the following features based on PostgreSQL:
Oracle compatible Packages
Oracle compatible PL/iSQL procedural language
GUC to switch between Oracle and PostgreSQL modes
Oracle compatible syntax for various DDL operations
IvorySQL is an open source project. One of the core goals of this project is to deliver oracle
compatibility, So that one can use the oracle code on IvorySQL database server.
Providing Oracle compatibility on top of PostgreSQL is a multi-dimensional task. Ranging from providing the Oracle compatible SQL syntax to adding support for data types that are either missing or behaves differently in PostgreSQL. One of the main core of Oracle compatibility is to provide the compatible PL (procedural language) in PostgreSQL that is functionally and syntactical compatible with Oracle's PL/SQL. For that purpose IvorySQL has added a new PL language PL/iSQL that that accepts, understands and executes the PL/SQL syntax.
And as you know one of the core feature of Oracle's PL/SQL is the PACKAGES.
Package is a schema object in Oracle that contains definitions for a group of related functionalities and is one of the most widely used feature of Oracle.
So In this blog I will give a introduction of Packages followed by an example on how you can create, use, and destroy Oracle style packages with IvorySQL.
So what are packages? The Packages are grouping of PL/iSQL code, divided in logical program units. In other words
a package can be considered a collection of related functions, procedures, variables or cursors. This collection is
collectively be accessed via the common name.
IvorySQL has PL/iSQL language that accepts, understands and executes the PL/SQL code. The packages use this same language. The packages have two main components.
Package Specification
The package specification lists all the items that can be accessed from outside the package. such as functions, procedures, variables and cursors. This is also know as public specification.
Package Body
The Package Body contains the implementation of all functions and procedures that are listed in the package specification. In addition these, it can also implement more function and procedure or other elements.
These elements that are not in the package specification, will be treated private members of the package and these can only be referenced from within the package. The outside access is not permitted.
The package body can also have a special code block called initializer block. This is a special because this block is
executed only once per session, at the very beginning when the package is first accessed.
Let's see some example of the code and see how a package operates.
First let's set the compatibility mode, so we can access oracle compatible features available in the ivorysql database.
SET compatible_mode TO oracle;
CREATE TABLE books ( id INT, title VARCHAR2(100), author VARCHAR2(100), price NUMBER);
INSERT INTO books VALUES (10, 'The Hobbit', 'J. R. R. Tolkien', 10.0); INSERT INTO books VALUES (11, 'Winnie-the-Pooh', 'A. A. Milne', 5.0); INSERT INTO books VALUES (12, 'Peter Pan', 'James Matthew Barrie', 4.0); INSERT INTO books VALUES (13, 'Charlie and the Chocolate Factory', 'Roald Dahl', 5.0); INSERT INTO books VALUES (14, 'SThe Jungle Book', 'Rudyard Kipling', 9.0); INSERT INTO books VALUES (15, 'The Little White Bird', 'James Matthew Barrie', 3.0);
Let's create a simple package. This package declares a cursor to list all available books. Have some subprograms to list, add and remove books. It also declares a some private variables to keep count and book information.
CREATE OR REPLACE PACKAGE mybooks AS CURSOR booksinfo IS SELECT * from BOOKS; PROCEDURE list_books; FUNCTION add_book(title VARCHAR2(100), author VARCHAR2(100), price NUMBER) RETURN bool; PROCEDURE remove_book(book_title VARCHAR2(100)); END; ivorysql$# / CREATE PACKAGE
CREATE OR REPLACE PACKAGE BODY mybooks AS -- declare private variables bookinfo booksinfo%rowtype; books_count INT; PROCEDURE list_books AS BEGIN OPEN booksinfo; RAISE INFO 'Book Info:'; RAISE INFO ''; LOOP FETCH booksinfo into bookinfo; EXIT WHEN NOT FOUND; RAISE INFO ' Name = %', bookinfo.title; RAISE INFO ' Author = %', bookinfo.author; RAISE INFO ' Price = %', bookinfo.price; RAISE INFO '------------------------------'; END LOOP; RAISE INFO 'Total Books = %', books_count; CLOSE booksinfo; END; FUNCTION add_book(title VARCHAR2(100), author VARCHAR2(100), price NUMBER) RETURN bool AS BEGIN INSERT INTO BOOKS VALUES ( books_count + 1, title, author, price); books_count := books_count + 1; RETURN true; EXCEPTION WHEN OTHERS THEN RETURN false; END; PROCEDURE remove_book(book_title VARCHAR2(100)) AS BEGIN DELETE FROM BOOKS WHERE title = book_title; EXCEPTION WHEN OTHERS THEN RAISE INFO 'Book % not found', book_title; END; -- initializer block BEGIN books_count := 0; SELECT count(*) INTO books_count FROM BOOKS; END; ivorysql$# / CREATE PACKAGE BODY
Let checkout the count. This anonymous block tries to access the private members of the package, which should result in error.
ivorysql=# DECLARE ivorysql$# nbooks int := 0; ivorysql$# BEGIN ivorysql$# nbooks := mybooks.books_count; ivorysql$# RAISE INFO 'Total Books = %', nbooks; ivorysql$# END; ivorysql$# / 2022-05-26 16:35:32.328 PKT [63554] ERROR: package private variable ("mybooks.books_count") is not accessible
Let's list all available books using the subprogram list_books of the package mybooks.
ivorysql=# BEGIN ivorysql$# mybooks.list_books; ivorysql$# END; ivorysql$# / INFO: Book Info: INFO: INFO: Name = The Hobbit INFO: Author = J. R. R. Tolkien INFO: Price = 10 INFO: ------------------------------ INFO: Name = Winnie-the-Pooh INFO: Author = A. A. Milne INFO: Price = 3 .... .... INFO: Total Books = 6 DO ivorysql=#
Let's add a new book using the subprogram add_book of the package mybooks.
DECLARE added bool; BEGIN added := mybooks.add_book('The Cat in the Hat', 'Dr. Seuss', 10); IF added = TRUE THEN RAISE INFO 'new book added'; END IF; END; /
CREATE OR REPLACE PACKAGE pkg_invrights AUTHID CURRENT_USER AS PROCEDURE curr_user; END; / CREATE OR REPLACE PACKAGE BODY pkg_invrights AS PROCEDURE curr_user AS BEGIN RAISE INFO 'Current User: %', current_user; END; END; /
-- Create a Package with DEFINER rights
CREATE OR REPLACE PACKAGE pkg_defrights AUTHID DEFINER AS PROCEDURE curr_user; END; / CREATE OR REPLACE PACKAGE BODY pkg_defrights AS PROCEDURE curr_user AS BEGIN RAISE INFO 'Current User: %', current_user; END; END; /
Let's see the package with invoker rights first.
ivorysql=> CALL pkg_invrights.curr_user; INFO: Current User: ivorysql CALL
Let's see the package with definer rights.
ivorysql=> CALL pkg_defrights.curr_user; INFO: Current User: ivorysql CALL
Let's switch to another user named ivuser
ivorysql=> \c ivorysql ivuser; You are now connected to database "ivorysql" as user "ivuser".
Let's see the package with invoker rights first.
ivorysql=> CALL pkg_invrights.curr_user; INFO: Current User: ivuser CALL
Let's see the package with definer rights.
ivorysql=> CALL pkg_defrights.curr_user; INFO: Current User: ivorysql CALL
As shown above when the package with invoker rights (pkg_invrights) is called, it's using the privileges of the user that invoked the package. However, when a definer package (pkg_defrights) is called, it still uses the privileges of the package owner.
IvorySQL can be built on Linux, OSX, Unix, and Windows platforms, and is basically the same as PostgreSQL compiled and installed. This article describes the steps for compiling source code on a Linux-based system.
HighGo Developer is a tool independently developed by Highgo, which supports not only Highgo database, but also PostgreSQL and IvorySQL database. The connection configuration is as follows:
Switch to the source directory and run the following commands:
make uninstall make clean
Delete residual directories and files:
systemctl disable ivorysql.servicemake --Disable the service mv /usr/lib/systemd/system/ivorysql.service /tmp/ --delete or move the service file to /tmp rm -fr /usr/local/pgsql --Remove the installed files
The ivorysql user and the corresponding environment variables can be cleared according to the situation.
The rest is the data directory "/ ivorysQL /1.2/data", please be sure to take a backup before processing.
There are installed dependency packages, you can decide whether to uninstall according to the situation.
If we have a requirement to specify the data file path (/ ivorysQL /1.2/data/) and port number (5866), then we can customize the initialization.
According to the default service file "/ usr/lib/systemd/system/ivorysql - 1. The service" in the same directory replication of a new "ivorysql - 5866. The service" :
alter system set listen_addresses = '*'; alter user ivorysql password '666666';
Note: User ivorysQL does not have a password. If you do not change the password, you can change the client authentication mode to Trust to avoid secret login.
Return to user root and restart the service for the Settings to take effect:
Note: The default ivorysQL service port is 5333. If this port is disabled, external clients fail to connect to the IVorysQL service through an IP address.
Highgo Developer is a tool independently developed by Highgo, which supports not only Highgo database, but also PostgreSQL and IvorySQL database. The connection configuration is as follows:
Since we installed through yum, it is recommended to use yum to uninstall. Try not to use RPM, which may cause incomplete uninstall. Of course, you can also uninstall it according to the Yum installation list.
Use the "yum history list" to determine the transaction ID of the yum installation:
[root@Node02 ~]# yum history list Loaded plugins: fastestmirror ID | Login user | Date and time | Action(s) | Altered ------------------------------------------------------------------------------- 5 | root <root> | 2022-04-27 12:38 | Install | 11 < 4 | root <root> | 2022-03-26 16:08 | Install | 35 > 3 | root <root> | 2022-03-26 16:07 | I, U | 19 2 | root <root> | 2022-03-26 16:07 | I, U | 73 1 | System <unset> | 2022-03-26 15:59 | Install | 299 history list
You can see that ID 5 is the transaction that performs the installation. Run the following command to uninstall (replace XX with 5) :
yum history undo XX
You can also use the following command to uninstall:
yum remove ivorysql-server
However, the command is not completely uninstalled, only removing two dependencies and failing to remove eight dependencies. You can decide whether to uninstall this way depending on whether to keep these dependencies.
The Postgres Conference in Silicon Valley is the largest PG conference on the West Coast and one of the most important Postgres conferences of the year in the US and globally. It will be held on April 7-8, 2022 (PDT) at the Hilton Hotel SAN Jose, California, USA. As an annual technology event for PostgreSQL technologists, practitioners, and enthusiasts around the world, the Silicon Valley Conference is dedicated to bringing together and discussing the relationship between people, Postgres, and data! The conference is as inclusive and fair as silicon Valley, bringing together the best speakers, audiences and sponsors, all working to create growth opportunities for the global Postgres ecosystem.
About 200 people attended the meeting, the largest offline meeting since the outbreak.
Bruce Momjian, a key member of the community, attended the conference, which was organized by PostgresConf,Joshua D.Drake, Jim Mlodgenski, and others. People from the United States,China, Canada, Brazil, Spain, Germany, India, Pakistan and other countries participated.
Grant Zhou, head of Highgo North America Research Institute and Secretary general of PostgreSQL China International Advisory Committee, was invited to participate in PostgreSQL internal development discussions and community project contributions.
The following is a two-day Postgres conference briefing in Silicon Valley brought to you by the IvorySQL open source database community.
Digital Rights and Privacy: Concerns for the 21st century--by Andres Arrieta
The Electronic Frontier Foundation has been protecting and fighting for our civil liberties for over 30 years. In those 30 years a lot has happened: Our relationship to the internet has fundamentally changed, and yet, in many ways, our understanding of how it works has remained stagnant. 30 years ago, the Internet was a mystical place of wizardry with many unknowns, and a realm which was difficult to access. Today it’s a core part of our life that we have become reliant on, and while it has become far easier than ever to access the many gifts that the Internet provides, understanding of how it works - from policy makers to enforcement agencies - continues to lag. During that time, EFF and its mission have grown to cover many of the aspects that technology has brought for better or worse and to help protect those impacted by it, while ensuring a bright future with innovation that improves our lives. So what is happening today and where are our efforts going? Why have some issues like privacy and competition become so strongly intertwined, and what new opportunities and threats lay ahead? I’ll walk you through some of our work, some of the areas of concern, and some of the things I believe will help us work towards a better future.
Past, Present, and Future of Logical Replication--by Amit Kapila
In this talk, I will tell how the Logical Replication has been evolved over years in PostgreSQL. This will explain some of the major recent enhancements like facilitating logical replication of two-phase and large in-progress transactions. I will share my views on how this technology can be leveraged to build a highly scalable and available database solution for large Enterprises. After that, I will also talk about some of the important enhancements being discussed in this technology area for future releases of PostgreSQL. I'll also cover how this technology can be enhanced for data migration from PostgreSQL to other databases.
IvorySQL--An Open Source Oracle-compatible Database Based on PostgreSQL--by GRANT ZHOU
There are many users who need to migrate their applications from Oracle to the open source Postgres, but in order to support the new database, users often need to re-develop the application, which is inconvenient. If there is a database based on Postgres and compatible with most Oracle syntax and functions, it will be too convenient for customers. However, the official Postgres project will not accept this kind of code submission. After all, Postgres is Postgres, and Oracle is Oracle. So, let's make an Oracle compatible database. This talk will introduce how to make a database compatible with Oracle syntax based on PG, and introduce the IvorySQL project. This project is an open source project (Apache 2.0) led by Highgo Software, and currently has released version 1.2 based on PostgreSQL 14.2. Welcome everyone to contribute on this open source Oracle compatible database - IvorySQL, powered by PostgreSQL.
Non-Relational Postgres--by Bruce Momjian
Postgres has always had strong support for relational storage. However, there are many cases where relational storage is either inefficient or overly restrictive. This talk shows the many ways that Postgres has expanded to support non-relational storage, specifically the ability to store and index multiple values, even unrelated ones, in a single database field. Such storage allows for greater efficiency and access simplicity, and can also avoid the negatives of entity-attribute-value (eav) storage. The talk will cover many examples of multiple-value-per-field storage, including arrays, range types, geometry, full text search, xml, json, and records.
Using Global database in Amazon Aurora PostgreSQL--by Shayon Sanyal and Sukhpreet Bedi
An Amazon Aurora Global database is designed for globally distributed applications, allowing a single Amazon Aurora database to span multiple AWS Regions. It replicates your data with no impact on database performance, enables fast local reads with low latency in each Region, and provides disaster recovery (DR) from Region-wide outages. In this session, learn how to plan for cross-Region DR and easily scale Aurora reads across the world to place your applications close to your users. You also learn how to meet your recovery point objective (RPO) and recovery time objective (RTO) with Amazon Aurora global databases.
Amazon Babelfish for Aurora--by chandra pathivada
Now the Babelfish for Aurora is available. This presentation is about how Babelfish helps customers to migrate SQL Server workloads to Postgres. In this presentation, we are going to give a demo of what is Babelfish , the internals of Aurora ,Aurora for SQL Server DBAs using Babelfish, and Labs on Application Migration.
The Biography of a Modern Cloud Native Application--by Alexandra Elchinoff and Karthik Ranganathan
Modern cloud native applications lead exciting lives - from their birth in the cloud and dealing with massive unplanned success to surviving cloud outages and handling customers worldwide. In this talk, Yugabyte CTO Karthik Ranganathan walks through the eventful life of a successful cloud native app, as seen from the perspective of the data layer.
PostgreSQL plays an important role in the development of databases in China. Many database products around the world choose PostgreSQL as their technology development path. However, the problem of migrating applications from Oracle to Open source Postgres became the biggest obstacle, so we created the IvorySQL open source project, which is based on the latest PostgreSQL 14 database with strong Oracle compatibility.
But why do we have to do IvorySQL open source project? How is it technically different from Postgres and Oracle? This webinar invites you to join us.
This webinar is hosted by Grant Zhou on IvorySQL - An Open Source Oracle-compatible Database Based on PostgreSQL.
Grant Zhou currently lived in Canada, he is the founder of Highgo Software North America, and he is leading the company PostgreSQL development team with members from Canada, China and Pakistan. He is working as the secretary of the International Consultant Committee of the PostgreSQL China Association at the same time, and also proud to be the Organizer & Asia Liaison at PostgresConf. He worked in Alcatel-Lucent (Nokia) company for more than ten years and had rich experiences on high availability, real-time telecommunication systems, database technologies and Unix/Linux programming.
In December 2021, the team announced the first available version of IvorySQL database, which is the only open source database with Oracle compatibility features based on PostgreSQL. On Feburay 28, 2022, based on PostgreSQL 14.2, IvorySQL 1.2 was released.
There are many users who need to migrate their applications from Oracle to the open source Postgres, but in order to support the new database, users often need to re-develop the application, which is inconvenient. If there is a database based on Postgres and compatible with most Oracle syntax and functions, it will be too convenient for customers. However, the official Postgres project will not accept this kind of code submission. After all, Postgres is Postgres, and Oracle is Oracle.
So, let's make an Oracle compatible database.
This talk will introduce how to make a database compatible with Oracle syntax based on PG, and introduce the IvorySQL project. This project is an open source project (Apache 2.0) led by Highgo Software and currently has released version 1.2 based on PostgreSQL 14.2.
Welcome everyone to contribute to this open source Oracle compatible database - IvorySQL, powered by PostgreSQL.
Just when the world was packing the bags for the holiday season and getting ready to welcome the New year we were hard at work and were giving the final touches to the project that our team was working on since the start of 2021. And it was the 15th of December just before the day end we got all green lights and silently released the very first version of IvorySQL before cleaning up the desk for that day.
IvorySQL is Apache 2.0 licensed Open Source Oracle compatible PostgreSQL. The very first release of IvorySQL is derived from PostgreSQL 14 with a firm commitment to always remain 100% compatible and a Drop-in replacement of the latest PostgreSQL.
IvorySQL adds a compatible_db GUC on top of existing standard PostgreSQL configuration parameters. The compatible_db is a toggle switch to switch between Oracle and PostgreSQL compatibility modes. The second major highlight of IvorySQL is PL/iSQL procedural language that supports oracle’s PL/SQL syntax. These two additions sit at the core of Oracle compatibility of IvorySQL without breaking the standard PostgreSQL compatibility. The compatible_db switches the behavior of functions and objects that exist in both Oracle and PostgreSQL and acts differently, while PL/iSQL builds the foundation for running the oracle code on IvorySQL with minimal changes.
IvorySQL comes with numerous Oracle compatibility features including Oracle style PACKAGES, DATA Types, and Conversion Functions. For details of Oracle compatibility features in IvorySQL refer to IvorySQL documentation
We are committed to following the principles of open source way
IvorySQL is committed to abiding by the principles of open-source ways and we strongly believe in building a healthy and inclusive community. We maintain that good ideas can come from anywhere, and the best ideas should win. Only by including diverse perspectives, we can reach to the best decision. While the first version of IvorySQL is mainly focused on Oracle Compatibility features, going forward the future road map and feature set will be determined by the community in an open-source way.
There are plenty of ways to contribute to IvorySQL. You can contribute by providing the documentation updates, by providing the translations for the documentation. If you have design skills you can contribute to the IvorySQL website project.
Testing the IvorySQL and reporting issues, by issuing pull requests for bug fixes or new features or answering the questions on mailing lists are some ways to contribute to the IvorySQL project and all types of contributions are welcomed and appreciated by the IvorySQL community.
All IvorySQL related projects including database server, website, and documentation are hosted and managed through Github. You can download the source code or released packages and track the current issues, pull requests, and discussions through the IvorySQL Github page.
Visit http://www.ivorysql.org and read the project documentation and contribution guidelines.
Join the IvorySQL community by subscribing to mailing lists: