Changelog: desember 2024 -------------------------------------------------------------------------------- + build & package MLFlow 2.18.0 (https://repo2.optimasidata.com/ODP/x86_64/0.2/centos9/0.2.0.0-04/mlflow/) november 2024 -------------------------------------------------------------------------------- + enhance reverse hosts + Update OpenSearch 2.18 (https://repo.onyx.id/analytic/RPM/x86_64/) oktober 2024 -------------------------------------------------------------------------------- + Update OpenSearch 2.17 (https://repo.onyx.id/analytic/RPM/x86_64/) september 2024 -------------------------------------------------------------------------------- + RAG Management + Update OpenSearch 2.16 (https://repo.onyx.id/analytic/RPM/x86_64/) agustus 2024 -------------------------------------------------------------------------------- + rebuild IMPALA 4.3.0 - fixing catalog access metastore - enhanced timezone database in HDFS (https://repo.onyx.id/ODP/x86_64/0.2/centos9/0.2.0.0-04/impala/) + Update to release KUDU 1.18.0: (https://repo.onyx.id/ODP/x86_64/0.2/centos9/0.2.0.0-04/kudu/) + patch KUDU 1.17.0: - enable Prometheus exporter - fixing strconv.ParseFloat: "kudu_master_clock_ntp_status" (https://repo.onyx.id/ODP/x86_64/0.2/centos9/0.2.0.0-04/kudu/) * Fixing NIFI script for writing login identity provider (ERROR Writing Login Identity Provider Failed Permission denied) + build Package hive-webHcat for querying via REST (https://repo.onyx.id/ODP/x86_64/0.2/centos9/0.2.0.0-04/hive/) juli 2024 -------------------------------------------------------------------------------- + Update ODP-Utils + add python altair libraries (https://repo.onyx.id/ODP-UTILS/) + Update OpenSearch 2.15 + bundling prometheus exporter + Flow Automation + Semantic / Neural Search + Chatbot Assistant (https://repo.onyx.id/analytic/RPM/x86_64/) juni 2024: -------------------------------------------------------------------------------- + Update OpenSearch 2.14 + fixing daemon pid + Machine Learning Model + Flow Automation + Semantic / Neural Search + Chatbot Assistant (https://repo.onyx.id/analytic/RPM/x86_64/) mei 2024: -------------------------------------------------------------------------------- + build OpenSearch 2.13.0 + fixing hdfs mode for spark-history (https://repo.onyx.id/analytic/RPM/x86_64/) april 2024: -------------------------------------------------------------------------------- + enable RockyOS 9 support + repackage RPM for RockyOS 9 maret 2024: -------------------------------------------------------------------------------- + build MLFlow + bundled ZEPPELIN with SPARK interpreter for SPARK-NLP (https://repo.onyx.id/ODP/x86_64/0.2/centos9/0.2.0.0-04/zeppelin/) + repackage SPARK with SPARK-NLP (https://repo.onyx.id/ODP/x86_64/0.2/centos9/0.2.0.0-04/spark3/) + rebuild & repackage SUPERSET for DORIS datasource bundled library mysqlclient (https://repo.onyx.id/ODP/x86_64/0.2/centos9/0.2.0.0-04/superset/) + fixing / repackage Script DOLPHINSCHEDULER 3.2.0 + fixing / repackage Script DORIS 1.2.7 + update IMPALA for KERBEROS security febuari 2024: -------------------------------------------------------------------------------- + build & packaging IMPALA 4.3.0 (https://repo2.optimasidata.com/ODP/x86_64/0.2/centos9/0.2.0.0-04/impala/) + build & packaging NIFI 1.25.0 (https://repo2.optimasidata.com/ODP/x86_64/0.2/centos9/0.2.0.0-04/nifi/) + build & packaging ZEPPELIN 0.11.0 (https://repo2.optimasidata.com/ODP/x86_64/0.2/centos9/0.2.0.0-04/zepelin/) + rebuild & packaging OPENSEARCH-DASHBOARDS 2.11.0 (https://repo2.optimasidata.com/ODP/x86_64/0.2/centos9/0.2.0.0-04/opensearch/) + rebuild & packaging OPENSEARCH 2.11.0 (https://repo2.optimasidata.com/ODP/x86_64/0.2/centos9/0.2.0.0-04/opensearch/) - dev FLINK for HUDI 0.14.1 - research / update ZEPPELIN 0.11.x for FLINK 1.17.2 + build & packaging FLINK 1.17.2 (https://repo2.optimasidata.com/ODP/x86_64/0.2/centos9/0.2.0.0-04/flink/) + enhancement FLINK kerberos security + build & packaging KYUUBI 1.7.2 (https://repo2.optimasidata.com/ODP/x86_64/0.2/centos9/0.2.0.0-04/kyuubi/) + build & packaging DORIS 1.2.7 (https://repo2.optimasidata.com/ODP/x86_64/0.2/centos9/0.2.0.0-04/doris/) januari 2024: -------------------------------------------------------------------------------- + build & packaging DOLPHINSCHEDULER 3.2.0 (https://repo2.optimasidata.com/ODP/x86_64/0.2/centos9/0.2.0.0-04/dolphin/) november 2023: -------------------------------------------------------------------------------- + rebuild & packaging KUDU 1.17.0 (https://repo2.optimasidata.com/ODP/x86_64/0.2/centos9/0.2.0.0-04/kudu/) + Supported authentication KNOX-SSO (hadoop-jwt) for OPENSEARCH security-backend + Supported authentication KNOX-SSO (hadoop-jwt) for AIRFLOW authorization + Supported authentication KNOX-SSO (hadoop-jwt) for SUPERSET authorization oktober 2023: -------------------------------------------------------------------------------- + build & update package TEZ 0.10.2 (for support iceberg) (https://repo2.optimasidata.com/ODP/x86_64/0.2/centos9/0.2.0.0-04/tez/) + building & packaging ICEBERG 1.2.0 (https://repo2.optimasidata.com/ODP/x86_64/0.2/centos9/0.2.0.0-04/iceberg/) + Build & Package apache STORM (https://repo2.optimasidata.com/ODP/x86_64/0.2/centos9/0.2.0.0-04/storm/) + repackage opensearch dashboard (anomaly detection plugins) + update config page for customize additional config opensearch.yml + add ranger-solr-plugin + repackage opensearch dashboard (custom visualization) + customize KNOX UI + Repackage NIFI package for ranger Audit & authorization + patched ranger-nifi-plugin september 2023: -------------------------------------------------------------------------------- ** release OBDP for CentOS Stream 9 x86_64 -------------------------------------------------------------------------------- + Add nifi-registry component + Build & Package nifi-registry + Build & Package nifi-ranger-plugin + re-Build & re-Package opensearch 2.9.0 (AD/LDAP integration) + Repackage Nifi package for AtlasLineage Reporting + Fixing LDAP/AD support scripts (setup-ldap & sync-ldap) + Fixing Hive, Kafka & Hbase import script for Atlas Release Candidate: 0.2.0.0-05-rc0 https://repo.onyx.id/ODP/x86_64/0.2/centos9/0.2.0.0-05-rc0/release-notes.txt -------------------------------- * build & testing Hadoop 3.3.6 * build & testing HBase 2.5.5 * build & testing Zookeeper 3.6.3 -------------------------------- september 2023: -------------------------------------------------------------------------------- ** release OBDP for CentOS Stream 9 x86_64 -------------------------------------------------------------------------------- + Fixing role command order + fixing import scipts Atlas (hive, hbase & kafka) august 2023 : -------------------------------------------------------------------------------- ** pre-release OBDP for CentOS Stream 9 x86_64 -------------------------------------------------------------------------------- + build & package R 4.3.1 (https://repo.onyx.id/ODP-GPL/0.2.0.0-04/centos9/) + remove deprecated config SOLR + patched jupyter interpreter for python3 + fixing SPARK jars archive for YARN executor engine + build ODP-UTILS package * include all depedencies python3 library for zeppelin * include curl.odp binary (https://repo2.optimasidata.com/ODP-UTILS/0.2.0.0-04/centos9/) + build & upgrade Hue package 4.11.0 + build & upgrade apache-ranger package 3.0.0 + build & upgrade apache-airflow package 2.7.0 + build & upgrade apache-zookeeper package 3.6.3 + all script rewrite to Python 3.9 ( based on CentOS 9 stocks ) + rewite all libraries, function, method (https://docs.python.org/3.1/whatsnew/3.0.html) + rebuild CURL package based on issue Writing WebHDFS API behind KERBEROS/SPNEGO (https://github.com/curl/curl/commit/6c6035532383e300c712e4c1cd9fdd749ed5cf59) july 2023 : -------------------------------------------------------------------------------- ** pre-release OBDP for CentOS Stream 9 x86_64 -------------------------------------------------------------------------------- + STACK feature - remove YARN Timeline Reader component + upgrade YARN Timeline Service 2.0 (https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html) + reimage container engine + packaging RPM all components + all script rewrite to Python 3.9 ( based on CentOS 9 stocks ) + rewite all libraries, function, method (https://docs.python.org/3.1/whatsnew/3.0.html) + upgrade psutil for python3 (https://psutil.readthedocs.io/en/latest/) + sparate script for writing config (.conf, .xml, .properties, .json) + enhance script for download internal resources + adjust encryption type for KERBEROS june 2023 : -------------------------------------------------------------------------------- ** initial release OBDP for CentOS Stream 9 x86_64 -------------------------------------------------------------------------------- + upgrade JDK 8 u361 java bug 8267837 (https://bugs.java.com/bugdatabase/view_bug?bug_id=8267837) + all script rewrite to Python 3.9 ( based on CentOS 9 stocks ) + rewite all libraries, function, method (https://docs.python.org/3.1/whatsnew/3.0.html) + upgrade simpleJson (https://simplejson.readthedocs.io/en/latest/) + replace internal ambari subprocess32 to subprocess (https://docs.python.org/3/library/subprocess.html) + replace internal massaging -> STOMP (https://stomppy.readthedocs.io/en/latest/intro.html) + -------------------------------------------------------------------------------- + airflow 2.4.0 bundled python 3.9.12 (individual library) (http://repo2.optimasidata.com/ODP/x86_64/0.2/centos7/0.2.0.0-04/airflow/) + superset 2.0.1 bundled python 3.9.12 (individual library) (http://repo2.optimasidata.com/ODP/x86_64/0.2/centos7/0.2.0.0-04/superset/) + solr 8.11.2 new feature: schema designer, security UI sebagai: backend ranger_audit, atlas history + opensearch 2.7.0 observability enhancement (http://repo2.optimasidata.com/ODP/x86_64/0.2/centos7/0.2.0.0-04/opensearch/) + flume 1.11.0 (http://repo2.optimasidata.com/ODP/x86_64/0.2/centos7/0.2.0.0-04/flume/) + ranger 2.4.0 (http://repo2.optimasidata.com/ODP/x86_64/0.2/centos7/0.2.0.0-04/ranger/)