From 59f3c642c0633460bd0658af9ee21d3a6a079e80 Mon Sep 17 00:00:00 2001 From: Bob Peulen <75362416+bobpeulen@users.noreply.github.com> Date: Wed, 10 Jun 2026 17:03:24 +0200 Subject: [PATCH] Updating 2026 and readme changes --- .../mysql-heatwave/README.md | 39 +++++++++++++ .../oci-big-data-service/README.md | 2 +- .../oci-cache/README.md | 24 ++++++-- .../oci-data-flow/README.md | 39 +++++-------- .../oci-no-sql/README.md | 2 +- .../oci-opensearch/readme.md | 34 ++++++++---- .../oci-postgresql/README.md | 55 ++++++++++++++----- .../oci-streaming-with-apache-kafka/README.md | 17 ++++-- .../oci-streaming/README.md | 25 ++++++--- 9 files changed, 164 insertions(+), 73 deletions(-) create mode 100644 data-platform/open-source-data-platforms/mysql-heatwave/README.md diff --git a/data-platform/open-source-data-platforms/mysql-heatwave/README.md b/data-platform/open-source-data-platforms/mysql-heatwave/README.md new file mode 100644 index 000000000..63e0b54f2 --- /dev/null +++ b/data-platform/open-source-data-platforms/mysql-heatwave/README.md @@ -0,0 +1,39 @@ +# MySQL HeatWave + +Reviewed: 10.06.2026 + +MySQL HeatWave is Oracle’s cloud database service that combines MySQL transactions, real-time analytics, machine learning, and vector search in one MySQL-compatible platform. It lets teams run operational and analytical workloads without moving data into separate systems, reducing complexity and latency. + +# Table of Contents + +1. [Team Publications](#team-publications) +2. [Useful Links](#useful-links) +3. [Reusable Assets](#reusable-assets) + +# Team Publications +- [Cloud-native analytics using Open-source tools with MySQL HeatWave](https://livelabs.oracle.com/ords/r/dbpm/livelabs/run-workshop?p210_wid=3234&p210_wec=&clear=210&session=118326321955831) +- [Building an AI Vision Search Engine with MySQL HeatWave GenAI](https://dasini.net/blog/2026/05/14/building-an-ai-vision-search-engine-with-mysql-heatwave-genai/) +- [Querying the Unstructured: Natural Language to SQL for JSON Data](https://dasini.net/blog/2025/10/14/querying-the-unstructured-natural-language-to-sql-for-json-data/) +- [Let Your AI DBA Assistant Write Your MySQL Queries](https://dasini.net/blog/2025/10/07/let-your-ai-dba-assistant-write-your-mysql-queries/) +- [Lightning-Fast Archiving in MySQL HeatWave Using Table Partition Exchange](https://blogs.oracle.com/mysql/%f0%9f%9a%80-lightning-fast-archiving-in-mysql-heatwave-using-table-partition-exchange) +- [How to do HeatWave Audit Archive and dump to Object Storage](https://blogs.oracle.com/mysql/heatwave-audit-archive-and-dump-to-object-storage) + +# Useful Links +- [MySQL Product Management Public](https://oracle.sharepoint.com/sites/oracleheatwave/HeatWave%20Collateral/Forms/AllItems.aspx) +- [The Oracle MySQL Blog](https://blogs.oracle.com/mysql/) +- [MySQL Community](https://github.com/mysql/mysql-community) + +# Reusable Assets +- [Getting Started with MySQL Database Service, HeatWave and Oracle Anaytics Cloud](https://www.youtube.com/watch?v=eBiNyAtZGYQ) +- [MySQL HeatWave: DB System Essentials](https://mylearn.oracle.com/ou/learning-path/become-a-heatwave-mysql-implementation-associate/146114) +- [MySQL HeatWave: Administration and Implementation](https://learn.oracle.com/ols/learning-path/mysql-heatwave-administration-and-implementation/133684/133660) +- [MySQL HeatWave: Administration and Implementation](https://learn.oracle.com/ols/learning-path/mysql-heatwave-administration-and-implementation/133684/133660) +- [Deploy and configure MySQL Database Service powered by HeatWave and Oracle Analytics Cloud](https://livelabs.oracle.com/ords/r/dbpm/livelabs/view-workshop?clear=RR,180&wid=870&session=111309056354428) + +# License + +Copyright (c) 2026 Oracle and/or its affiliates. + +Licensed under the Universal Permissive License (UPL), Version 1.0. + +See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details. \ No newline at end of file diff --git a/data-platform/open-source-data-platforms/oci-big-data-service/README.md b/data-platform/open-source-data-platforms/oci-big-data-service/README.md index cfbadfb35..41ec5e2ed 100644 --- a/data-platform/open-source-data-platforms/oci-big-data-service/README.md +++ b/data-platform/open-source-data-platforms/oci-big-data-service/README.md @@ -3,7 +3,7 @@ Oracle Big Data Service is a fully managed, automated cloud service that provide Easily create secure and scalable Hadoop-based data lakes that can quickly process large amounts of data. BDS is based on Oracle [Hadoop Distribution](https://docs.oracle.com/en-us/iaas/Content/bigdata/overview.htm#overview-odh). -Reviewed: 11.11.2025 +Reviewed: 10.06.2026 # Table of Contents diff --git a/data-platform/open-source-data-platforms/oci-cache/README.md b/data-platform/open-source-data-platforms/oci-cache/README.md index 3d4b1c44c..371282c77 100644 --- a/data-platform/open-source-data-platforms/oci-cache/README.md +++ b/data-platform/open-source-data-platforms/oci-cache/README.md @@ -2,7 +2,7 @@ OCI Cache with Redis is a comprehensive, managed in-memory caching solution built on the foundation of open source Redis. This fully managed service accelerates data reads and writes, significantly enhancing application response times and database performance to provide an improved customer experience. -Reviewed: 11.11.2025 +Reviewed: 10.06.2026 # Table of Contents @@ -12,22 +12,34 @@ Reviewed: 11.11.2025 # Team Publications -- [Leverage OCI-managed Redis and PostgreSQL for your e-commerce application](https://docs.oracle.com/en/solutions/oci-redis-postgresql/index.html#GUID-DD63C617-DEEE-4357-B203-A3CFDF1B34EC) -- [Enable a Low Code Modular LLM App Engine using Oracle Integration and OCI Generative AI](https://docs.oracle.com/en/solutions/oci-generative-ai-integration/index.html#GUID-0C310162-34D9-4EB2-978D-FBAFB931E637) +## Github +- [Connect OCI Cache through Network Load Balancer](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-cache/connect-via-nlb) +- [Vector Search with OCI Cache (Valkey 8.1) and OCI Data Science Notebook](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-cache/vector-search) + + +## Architecture Center & Oracle Learn +- [Modernize your application development with OCI-managed PostgreSQL, Redis, and OpenSearch](https://docs.oracle.com/en/solutions/modernize-app-dev-oci-postgresql-redis-opensearch/#GUID-DA0594DA-D549-481E-9CBD-46735766CA82) +- [Connect to Oracle Cloud Infrastructure Cache with Redis using Redis Insight](https://docs.oracle.com/en/learn/oci-cache-redis/#introduction) + + +## Blogs - [Upgrade OCI Cache with Redis to Valkey](https://medium.com/@devpiotrekk/upgrade-oci-cache-with-redis-to-valkey-d3c01deb8733) - [Serverless Deployment of Valkey Admin with OCI Container Instances](https://medium.com/@devpiotrekk/serverless-deployment-of-valkey-admin-with-oci-container-instances-dd1cb3debab2) -# Useful Links +## LiveLabs +- [LiveLabs: Accelerating IoT applications with OCI Cache and OCI PostgreSQL](https://livelabs.oracle.com/ords/r/dbpm/livelabs/run-workshop?p210_wid=4383&p210_wec=&session=119324071827764) + +# Useful Links - [OCI Cache with Redis Documentation](https://docs.oracle.com/en-us/iaas/Content/redis/home.htm) - [OCI Cache with Redis FAQ](https://www.oracle.com/uk/cloud/redis/faq/) - [OCI Cache with Redis Introduction](https://blogs.oracle.com/cloud-infrastructure/post/oci-cache-redis) # Reusable Assets +- [Leverage OCI-managed Redis and PostgreSQL for your e-commerce application](https://docs.oracle.com/en/solutions/oci-redis-postgresql/index.html#GUID-DD63C617-DEEE-4357-B203-A3CFDF1B34EC) +- [Enable a Low Code Modular LLM App Engine using Oracle Integration and OCI Generative AI](https://docs.oracle.com/en/solutions/oci-generative-ai-integration/index.html#GUID-0C310162-34D9-4EB2-978D-FBAFB931E637) -- [Connect OCI Cache through Network Load Balancer](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-cache/connect-via-nlb) -- [Vector Search with OCI Cache (Valkey 8.1) and OCI Data Science Notebook](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-cache/vector-search) # License diff --git a/data-platform/open-source-data-platforms/oci-data-flow/README.md b/data-platform/open-source-data-platforms/oci-data-flow/README.md index 246cc3314..4e3f34ed0 100644 --- a/data-platform/open-source-data-platforms/oci-data-flow/README.md +++ b/data-platform/open-source-data-platforms/oci-data-flow/README.md @@ -1,7 +1,7 @@ # OCI Data Flow Oracle Cloud Infrastructure (OCI) Data Flow is a fully managed Apache Spark service that performs processing tasks on extremely large datasets—without infrastructure to deploy or manage. Developers can also use Spark Streaming to perform cloud ETL on their continuously produced streaming data. This enables rapid application delivery because developers can focus on app development, not infrastructure management -Reviewed: 11.11.2025 +Reviewed: 10.06.2026 # Table of Contents @@ -11,40 +11,27 @@ Reviewed: 11.11.2025 # Team Publications -- [Data Science Data Flow Notebook Samples](https://github.com/oracle-samples/oci-data-science-ai-samples/tree/main/notebook_examples) -- [Machine Learning with OCI Data Flow](https://www.youtube.com/watch?v=A6uVbK7wQb4) -- [Extracting data from Salesforce in near real-time using OCI Data Flow — Part 1](https://medium.com/@eloi-lopes29/extracting-data-from-salesforce-in-near-real-time-using-oci-data-flow-part-1-f096886b9fcd) -- [OCI Audit Logs to Object Storage with Data Flow](https://blogs.oracle.com/cloud-infrastructure/post/behind-the-scenes-shrinking-log-analysis) -- [Predict energy consumption with OCI Data Flow and Spark MLlib](https://medium.com/data-engineer-things/predict-energy-consumption-with-oci-data-flow-and-spark-mllib-74626c4db56a) +- [Build and deploy OCI DataFlow application using OCI Data Science - Example](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/build-and-deploy-app-from-oci-ds) +- [Load data from OCI Data Flow into Autonomous Database](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/load-data-to-adw) +- [Connect to Salesforce using OCI Data Flow](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/connect-to-salesforce) +- [Run OCI Data Flow from OCI Functions](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/run-from-functions) +- [Connect to AWS SR](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/connect-to-AWS-S3) +- [Connect to PostgreSQL](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/connect-to-postgresql) +- [Connect to Snowflake](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/connect-to-Snowflake) - [Apache Spark with OCI Data Flow and Oracle Autonomous Database](https://medium.com/@sylwekdec/apache-spark-with-oci-data-flow-and-oracle-autonomous-database-bd96055445ee) +- [Extracting data from Salesforce in near real-time using OCI Data Flow — Part 1](https://medium.com/@eloi-lopes29/extracting-data-from-salesforce-in-near-real-time-using-oci-data-flow-part-1-f096886b9fcd) # Useful Links - - [OCI Data Flow - Apache SPARK Service](https://www.oracle.com/big-data/data-flow/) - [Code Samples](https://github.com/oracle-samples/oracle-dataflow-samples) # Reusable Assets +- [Data Science Data Flow Notebook Samples](https://github.com/oracle-samples/oci-data-science-ai-samples/tree/main/notebook_examples) +- [Machine Learning with OCI Data Flow](https://www.youtube.com/watch?v=A6uVbK7wQb4) +- [OCI Audit Logs to Object Storage with Data Flow](https://blogs.oracle.com/cloud-infrastructure/post/behind-the-scenes-shrinking-log-analysis) +- [Predict energy consumption with OCI Data Flow and Spark MLlib](https://medium.com/data-engineer-things/predict-energy-consumption-with-oci-data-flow-and-spark-mllib-74626c4db56a) -- [Build and deploy OCI DataFlow application using OCI Data Science - Example](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/build-and-deploy-app-from-oci-ds) -When using OCI Data Science to build and deploy an OCI Data Flow application. Using the notebook sessions, you can either directly interact with an OCI Data Flow cluster in-line and test your Spark code, and afterwards easily deploy and run the OCI Data Flow application. - -- [Load data from OCI Data Flow into Autonomous Database](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/load-data-to-adw) -When you are planning to use an Autonomous Database as a source and/or Autonomous Database as a target when running an OCI Data Flow application. - -- [Connect to Salesforce using OCI Data Flow](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/connect-to-salesforce) -When you are looking to use Salesforce data in your OCI Data Flow application, you can use the script to establish the connection and query relevant Salesforce data. - -- [Run OCI Data Flow from OCI Functions](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/run-from-functions) -When in your overall flow OCI Functions are used (e.g., based on an event) to start an OCI Data Flow job run. - -- [Connect to AWS SR](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/connect-to-AWS-S3) -When you are using AWS S3 to store files and these files need to be processed in your OCI Data Flow application, you can use this file and extract the code snippet to establish the connection. - -- [Connect to PostgreSQL](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/connect-to-postgresql) -When you are using PostgreSQL database to store and retrieve data and you need to establish a connection between OCI Data Flow and you PostgreSQL instance. -- [Connect to Snowflake](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/connect-to-Snowflake) -When you are using Snowflake as your database and you need to establish a connection between OCI Data Flow and your Snowflake instance. # License diff --git a/data-platform/open-source-data-platforms/oci-no-sql/README.md b/data-platform/open-source-data-platforms/oci-no-sql/README.md index 611fd1f68..9d4bb678e 100644 --- a/data-platform/open-source-data-platforms/oci-no-sql/README.md +++ b/data-platform/open-source-data-platforms/oci-no-sql/README.md @@ -1,7 +1,7 @@ # OCI NoSQL Oracle NoSQL Database Cloud Service makes it easy for developers to build applications using document, fixed schema, and key-value database models, delivering predictable single-digit millisecond response times with data replication for high availability. The service offers active-active regional replication, ACID transactions, serverless scaling, comprehensive security, and low pay-per-use pricing for both on-demand and provisioned capacity modes, including 100% compatibility with on-premises Oracle NoSQL Database. -Reviewed: 11.11.2025 +Reviewed: 10.06.2026 # Table of Contents diff --git a/data-platform/open-source-data-platforms/oci-opensearch/readme.md b/data-platform/open-source-data-platforms/oci-opensearch/readme.md index d77dfd541..3a5f37138 100644 --- a/data-platform/open-source-data-platforms/oci-opensearch/readme.md +++ b/data-platform/open-source-data-platforms/oci-opensearch/readme.md @@ -3,7 +3,7 @@ OCI Search with OpenSearch is a managed service that you can use to build in-app Search with OpenSearch handles all the management and operations of search clusters, including operations such as security updates, upgrades, resizing, and scheduled backups. This allows you to focus your resources on building features for your OpenSearch solutions. -Reviewed: 11.11.2025 +Reviewed: 10.06.2026 # Table of Contents @@ -13,29 +13,39 @@ Reviewed: 11.11.2025 # Team Publications -- [Step-by-step migration guide](https://docs.oracle.com/en-us/iaas/Content/search-opensearch/Concepts/importingacluster.htm) -- [LiveLabs: Search Documents stored in Object Storage using OpenSearch, Generative AI, Semantic Search, RAG](https://apexapps.oracle.com/pls/apex/f?p=133:180:239256605646::::wid:3762) +### Github +- [Create a full RAG pipeline using OCI OpenSearch and the GenAI service](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-opensearch/code-examples/rag-oci-opensearch-genai-service) +- [Create a NGINX server to access the OCI OpenSearch Dashboards](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-opensearch/code-examples/nginx-server) +- [Run Anomaly Detection in OCI OpenSearch and receive an alert using Oracle Notification Service](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-opensearch/code-examples/anomaly-detection-onsh) +- [Exporting Kubernetes Logs to OCI OpenSearch Using Fluent-Bit](https://github.com/andreumdorokhinum/oci_k8s_logs_to_opensearch) - [Retrieval Augmented Generation with OCI OpenSearch and GenAI service](https://github.com/bobpeulen/oci_opensearch/blob/main/oci_opensearch_rag_auto.ipynb) -A notebook describing and performing all steps to create and store a custom embedding model in the OCI OpenSearch cluster and create a full RAG pipeline (OCI OpenSearch as Vector database and in-memory engine and the GenAI service (cohere) as LLM) -- [LiveLabs: Search and visualize data with OCI Search Service with OpenSearch](https://apexapps.oracle.com/pls/apex/f?p=133:180:6071760449919::::wid:3427) +- [Ingest OCI PostgreSQL logs into OCI OpenSearch for database monitoring](https://github.com/bobpeulen/oci_opensearch/tree/main/postgresql_logs) + +### Blogs - [How to Interact with OpenSearch?](https://www.linkedin.com/pulse/how-interact-opensearch-isma%C3%ABl-hassane-j7z9f/?trackingId=TbuchZqCSDa9X65sWhx8xw%3D%3D) - [Architecting with OpenSearch](https://www.linkedin.com/pulse/architecting-opensearch-isma%C3%ABl-hassane-gz1jf/?trackingId=xw1G1Yq9SMutkogC3FIJmg%3D%3D) + +### Video - [Developer Coaching - Building Real-Time Streams with OCI Streaming with Apache Kafka](https://www.youtube.com/watch?v=AUiuGH05MPE) +- [Building Real-Time Streams with OCI Streaming with Apache Kafka](https://www.youtube.com/watch?v=AUiuGH05MPE) +- [Cross-Reference Code Mapping System With Opensearch](https://www.youtube.com/watch?app=desktop&v=RyM7k54U9ts) +- [Learn Why OCI is the best platform for Application Modernization on demand](https://videohub.oracle.com/media/Learn+Why+OCI+is+the+best+platform+for+Application+Modernization+on+demand/1_x4oie4tn?elq_mid=264562&sh=%2038&cmid=CORP241213P00019C00002) -# Useful Links +### Architecture Center +- [Modernize your application development with OCI-managed PostgreSQL, Redis, and OpenSearch](https://docs.oracle.com/en/solutions/modernize-app-dev-oci-postgresql-redis-opensearch/#GUID-DA0594DA-D549-481E-9CBD-46735766CA82) + +# Useful Links +- [OCI Search with OpenSearch - Documentation](https://docs.oracle.com/en-us/iaas/Content/search-opensearch/home.htm) - [Search and visualize data using OCI Search Service with OpenSearch](https://docs.oracle.com/en/learn/oci-opensearch/index.html) - [Use OCI Search Service with OpenSearch to build in-application search - architecture pattern](https://docs.oracle.com/en/solutions/oci-opensearch-application-search/#GUID-AEAA600E-BBCC-4102-8E23-ABEC941FE84C) # Reusable Assets +- [Step-by-step migration guide](https://docs.oracle.com/en-us/iaas/Content/search-opensearch/Concepts/importingacluster.htm) +- [LiveLabs: Search Documents stored in Object Storage using OpenSearch, Generative AI, Semantic Search, RAG](https://apexapps.oracle.com/pls/apex/f?p=133:180:239256605646::::wid:3762) +- [LiveLabs: Search and visualize data with OCI Search Service with OpenSearch](https://apexapps.oracle.com/pls/apex/f?p=133:180:6071760449919::::wid:3427) -- [Create a full RAG pipeline using OCI OpenSearch and the GenAI service](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-opensearch/code-examples/rag-oci-opensearch-genai-service) -When you are looking to use build a full RAG pipeline using OCI OpenSearch (as a vector database and as an in-memory engine) and the GenAI service, using the OCI Data Science service. Largely, the steps are documented and automated to help you create the pipeline. The notebook includes a small interactive chatbot you can use to interact within a conversation. -- [Create a NGINX server to access the OCI OpenSearch Dashboards](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-opensearch/code-examples/nginx-server) -When many people need access to the OCI OpenSearch dashboards and you want them to use one single point of entry, being the public URL. You can use these steps to install an NGINX server on a compute, providing you access to the OCI OpenSearch dashboard with full control over your security. -- [Run Anomaly Detection in OCI OpenSearch and receive an alert using Oracle Notification Service](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-opensearch/code-examples/anomaly-detection-onsh) -- [Exporting Kubernetes Logs to OCI OpenSearch Using Fluent-Bit](https://github.com/andreumdorokhinum/oci_k8s_logs_to_opensearch) # License diff --git a/data-platform/open-source-data-platforms/oci-postgresql/README.md b/data-platform/open-source-data-platforms/oci-postgresql/README.md index fd9feccbc..ceff68ebd 100644 --- a/data-platform/open-source-data-platforms/oci-postgresql/README.md +++ b/data-platform/open-source-data-platforms/oci-postgresql/README.md @@ -1,6 +1,6 @@ # OCI PostgreSQL -Reviewed: 11.11.2025 +Reviewed: 10.06.2026 OCI Database with PostgreSQL is a fully managed PostgreSQL-compatible service with intelligent sizing, tuning, and high durability. @@ -16,9 +16,22 @@ OCI Database with PostgreSQL is designed for high availability by offering durab 3. [Reusable Assets](#reusable-assets) # Team Publications -- [Automate Cold Disaster Recovery for OCI Database with PostgreSQL using OCI Full Stack Disaster Recovery -](https://docs.oracle.com/en/learn/full-stack-dr-pgsql-cold-dr/#introduction) -- [Migrate to OCI PostgreSQL Database with OCI GoldenGate](https://blogs.oracle.com/dataintegration/post/seamlessly-migrate-an-onpremise-postgresql-database-to-oci-database-with-postgresql-online-with-oci-goldengate) + +### Github +- [Create a connection between OCI PostgreSQL and Oracle Analytics Cloud](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-postgresql/code-examples/connect-to-oac) +- [Send notifications based on pg_stat_activity in OCI PostgreSQL](https://github.com/andreumdorokhinum/oci_pg_stat_activity) +- [GitLab & Standalone Managed PostgreSQL on OCI](https://github.com/andreumdorokhinum/oci_pg_with_gitlab) +- [Use CRON as scheduler for OCI PostgreSQL](https://github.com/andreumdorokhinum/oci_pg_with_unix_cron) +- [Integrate Geoserver and PostGIS using OCI Database with PostgreSQL](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-postgresql/code-examples/postgis-geoserver) +- [Set up PgBouncer for Connection Pooling with OCI Database with PostgreSQL](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-postgresql/code-examples/pgbouncer-setup) +- [Use PostgreSQL MCP Pro with OCI Database with PostgreSQL](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-postgresql/postgres-mcp) + +### Oracle Learn & Architecture Center +- [Automate Cold Disaster Recovery for OCI Database with PostgreSQL using OCI Full Stack Disaster Recovery](https://docs.oracle.com/en/learn/full-stack-dr-pgsql-cold-dr/#introduction) +- [Monitor an OCI Database with PostgreSQL using Prometheus and Grafana](https://docs.oracle.com/en/learn/ocipgsql-promgra/#introduction) +- [Modernize your application development with OCI-managed PostgreSQL, Redis, and OpenSearch](https://docs.oracle.com/en/solutions/modernize-app-dev-oci-postgresql-redis-opensearch/#GUID-DA0594DA-D549-481E-9CBD-46735766CA82) + +### Blogs - [OCI PostgreSQL to OCI PostgreSQL cross-region replication with OCI GoldenGate — Part 1](https://medium.com/@devpiotrekk/oci-postgresql-to-oci-postgresql-cross-region-replication-with-oci-goldengate-introduction-e0492fc37b92) - [OCI PostgreSQL to OCI PostgreSQL cross-region replication with OCI GoldenGate — Part 2](https://medium.com/@devpiotrekk/oci-postgresql-to-oci-postgresql-cross-region-replication-with-oci-goldengate-oci-postgresql-d4fcffc47498) - [OCI PostgreSQL to OCI PostgreSQL cross-region replication with OCI GoldenGate — Part 3](https://medium.com/@devpiotrekk/oci-postgresql-to-oci-postgresql-cross-region-replication-with-oci-goldengate-oci-goldengate-4ccd5dea4d6c) @@ -26,25 +39,41 @@ OCI Database with PostgreSQL is designed for high availability by offering durab - [OCI PostgreSQL vector search with pgvector - Part 1](https://medium.com/@devpiotrekk/vector-search-with-pgvector-and-oci-database-with-postgresql-part-1-0915e5296148) - [Benchmarking OCI Database with PostgreSQL](https://medium.com/@andreumdorokhinum/benchmarking-oci-database-with-postgresql-0a665e575fde) - [Migrate PostgreSQL to OCI PostgreSQL using OCI Object Storage and Rclone](https://medium.com/@sylwekdec/migrate-postgresql-to-oci-postgresql-using-oci-object-storage-and-rclone-a61ef97c5b96) +- [Does Postgres need the Boyer-Moore-Horspool search algorithm for LIKE operator?](https://medium.com/@andreumdorokhinum/does-postgres-need-the-boyer-moore-horspool-search-algorithm-for-like-operator-00b43e4b115c) +- [Integration of OCI Database with PostgreSQL and Oracle Audit Vault and Database Firewall](https://medium.com/@andreumdorokhinum/integration-of-oci-database-with-postgresql-and-oracle-audit-vault-and-database-firewall-f98236b980bd) + +### LiveLabs +- [LiveLabs: Accelerating IoT applications with OCI Cache and OCI PostgreSQ](https://livelabs.oracle.com/ords/r/dbpm/livelabs/run-workshop?p210_wid=4383&p210_wec=&session=119324071827764) + +### Video: +- [Real-time insights and anomaly detection in ATM transactions](https://www.youtube.com/watch?v=ScM7zxe65A8) +- [Real-Time IoT Mastery - Powering Microcontrollers with OCI Open-Source Tools](https://www.youtube.com/watch?v=TxkR4o_m3ls) +- [Airport Chatbot with OCI, AI and Open-Source services](https://www.youtube.com/watch?v=rs-RtvtKkpg) +- [Seamless Integration of OCI PostgreSQL Logs with Grafana](https://www.youtube.com/watch?v=gM9xJAmE0kY) # Useful Links - [OCI PostgreSQL Documentation](https://docs.oracle.com/en-us/iaas/Content/postgresql/home.htm) -- [OCI PostgreSQL launch blog](https://blogs.oracle.com/cloud-infrastructure/post/oci-database-postgres) - [OCI PostgreSQL features](https://blogs.oracle.com/cloud-infrastructure/post/first-principles-optimizing-postgresql-for-the-cloud) - [Terraform to deploy OCI PostgreSQL database](https://blogs.oracle.com/cloud-infrastructure/post/deploy-managed-oci-database-with-postgresql-service-with-terraform) - [Backup and Restore an OCI Database with PostgreSQL](https://docs.oracle.com/en/learn/backup-and-restore-db-with-postgresql/index.html#introduction) # Reusable Assets -- [Create a connection between OCI PostgreSQL and Oracle Analytics Cloud](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-postgresql/code-examples/connect-to-oac) -When you are looking to establish an OCI PostgreSQL instance, connect to it, and connect to Oracle Analytics Cloud, use these steps to guide you. The steps include using DBeaver to create a new table and load data, create an OCI PostgreSQL instance, connect to it, and connect the instance as source to Oracle Analytics Cloud. -- [Send notifications based on pg_stat_activity in OCI PostgreSQL](https://github.com/andreumdorokhinum/oci_pg_stat_activity) -- [GitLab & Standalone Managed PostgreSQL on OCI](https://github.com/andreumdorokhinum/oci_pg_with_gitlab) -- [Use CRON as scheduler for OCI PostgreSQL](https://github.com/andreumdorokhinum/oci_pg_with_unix_cron) -- [Integrate Geoserver and PostGIS using OCI Database with PostgreSQL](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-postgresql/code-examples/postgis-geoserver) -- [Set up PgBouncer for Connection Pooling with OCI Database with PostgreSQL](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-postgresql/code-examples/pgbouncer-setup) -- [Use PostgreSQL MCP Pro with OCI Database with PostgreSQL](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-postgresql/postgres-mcp) +### General & Best Practices +- [First Principles: Optimizing PostgreSQL for the cloud](https://blogs.oracle.com/cloud-infrastructure/first-principles-optimizing-postgresql-for-the-cloud) +- [Blue-Green Deployment for OCI PostgreSQL](https://medium.com/oracledevs/blue-green-deployment-for-oci-postgresql-1068faa8ce1c) +- [Storage](https://docs.oracle.com/en-us/iaas/Content/postgresql/storage-best-practices.htm) +- [Resource Monitoring & Troubleshooting](https://blogs.oracle.com/cloud-infrastructure/oci-postgresql-monitoring-troubleshooting-guide) +- [Database Performance](https://blogs.oracle.com/cloud-infrastructure/oci-postgresql-best-practices-for-database) +- [Metrics](https://blogs.oracle.com/cloud-infrastructure/oci-postgresql-monitoring-metrics) + +### Migration & Replication +- [Migrate to OCI PostgreSQL Database with OCI GoldenGate](https://blogs.oracle.com/dataintegration/post/seamlessly-migrate-an-onpremise-postgresql-database-to-oci-database-with-postgresql-online-with-oci-goldengate) +- [Migrate Amazon RDS for PostgreSQL Database to OCI Database with PostgreSQL using OCI GoldenGate](https://docs.oracle.com/en/learn/amznrds-ocipostgre/index.html#introduction) +- [Migrate Data from On-premises PostgreSQL Database to OCI Database with PostgreSQL](https://docs.oracle.com/en/learn/migrate-onpremises-postgres-to-oci-db/index.html#introduction) +- [Bi-directional replication in OCI Database for PostgreSQL using pglogical](https://docs.oracle.com/en/learn/bi-directional-sync-pglogical/#introduction) +- [Importing, Exporting, and Migrating Databases in OCI Database with PostgreSQL](https://docs.oracle.com/en-us/iaas/Content/postgresql/import-export-migrate.htm) # License diff --git a/data-platform/open-source-data-platforms/oci-streaming-with-apache-kafka/README.md b/data-platform/open-source-data-platforms/oci-streaming-with-apache-kafka/README.md index 661ba638d..3c9849463 100644 --- a/data-platform/open-source-data-platforms/oci-streaming-with-apache-kafka/README.md +++ b/data-platform/open-source-data-platforms/oci-streaming-with-apache-kafka/README.md @@ -1,7 +1,7 @@ # OCI Streaming with Apache Kafka A fully managed Kafka service that allows you to build real-time, distributed data streaming pipelines so you can collect, process, store, and move millions of events per minute in a cost-efficient manner that’s 100% compatible with open source Apache Kafka. -Reviewed: 11.11.2025 +Reviewed: 10.06.2026 # Table of Contents @@ -10,18 +10,25 @@ Reviewed: 11.11.2025 3. [Reusable Assets](#reusable-assets) # Team Publications + +### Github +- [Kafka UI & Kafka Connect Setup with OCI OpenSearch](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-streaming-with-apache-kafka/code-examples/kafka-ui-connect-setup-with-oci-opensearch) +- [OCI GoldenGate connection to OCI Streaming with Apache Kafka](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-streaming-with-apache-kafka/code-examples/goldengate_oci_streaming-with-apache-kafka) +- [Configuring Schema registry and Kafka connect with AKHQ(UI) for OSAK](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-streaming-with-apache-kafka/code-examples/schema-registry-akhq-setup) +- [MirrorMaker2 Setup Guide for Primary-DR Replication](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-streaming-with-apache-kafka/code-examples/osak-setting-up-dr-with-mirrormaker2) +- [Fraud Detection Kafka Demo](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-streaming-with-apache-kafka/code-examples/fraud-detection-demo) + + +### Video - [Developer Coaching - Building Real-Time Streams with OCI Streaming with Apache Kafka](https://www.youtube.com/watch?v=AUiuGH05MPE) # Useful Links - - [OCI Streaming with Apache Kafka Documentation](https://docs.oracle.com/en-us/iaas/Content/kafka/home.htm) - [OCI Streaming with Apache Kafka OCI CLI Documentation](https://docs.oracle.com/en-us/iaas/tools/python/2.160.0/api/managed_kafka.html#) # Reusable Assets +- [OCI Streaming with Apache Kafka — Quick Demo Setup](https://medium.com/@jahangir2526/oci-streaming-with-apache-kafka-quick-demo-setup-0a90cfa5ff19) -- [Kafka UI & Kafka Connect Setup with OCI OpenSearch](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-streaming-with-apache-kafka/code-examples/kafka-ui-connect-setup-with-oci-opensearch) -- [OCI GoldenGate connection to OCI Streaming with Apache Kafka](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-streaming-with-apache-kafka/code-examples/goldengate_oci_streaming-with-apache-kafka) -- [Configuring Schema registry and Kafka connect with AKHQ(UI) for OSAK](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-streaming-with-apache-kafka/code-examples/schema-registry-akhq-setup) # License diff --git a/data-platform/open-source-data-platforms/oci-streaming/README.md b/data-platform/open-source-data-platforms/oci-streaming/README.md index 216b6c4c6..76c8d2e1d 100644 --- a/data-platform/open-source-data-platforms/oci-streaming/README.md +++ b/data-platform/open-source-data-platforms/oci-streaming/README.md @@ -1,7 +1,7 @@ # OCI Streaming The Oracle Cloud Infrastructure Streaming service provides a fully managed, scalable, and durable solution for ingesting and consuming high-volume data streams in real-time. Use Streaming for any use case in which data is produced and processed continually and sequentially in a publish-subscribe messaging model. -Reviewed: 11.11.2025 +Reviewed: 10.06.2026 # Table of Contents @@ -11,21 +11,28 @@ Reviewed: 11.11.2025 # Team Publications -- [LiveLabs: Deploying OCI Streaming Service](https://apexapps.oracle.com/pls/apex/f?p=133:180:107188281482541::::wid:664) -- [LiveLabs: How do I ingest messages into OCI streaming in real-time with Oracle GoldenGate for Big Data?](https://apexapps.oracle.com/pls/apex/r/dbpm/livelabs/run-workshop?p210_wid=3572&session=107188281482541) +### Github +- [Fake Producer and Consumer for OCI Streaming](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-streaming/code-examples/fake-producer-consumer) +- [Create and run Mosquitto & Node-RED, connecting to OCI Streaming](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-streaming/code-examples/mosquitto_node-red) -# Useful Links +### Blogs +- [Revival of the Magical Suitcase](https://medium.com/@devpiotrekk/revival-of-the-magical-suitcase-73093af23f29) +- [Node-RED with OCI Streaming and Autonomous Database](https://medium.com/@sylwekdec/node-red-with-oci-streaming-and-autonomous-database-fd6e21578a70) +### Video +- [Real-time insights and anomaly detection in ATM transactions](https://www.youtube.com/watch?v=ScM7zxe65A8) +- [Real-Time IoT Mastery - Powering Microcontrollers with OCI Open-Source Tools](https://www.youtube.com/watch?v=TxkR4o_m3ls) +- [Real-time KPN IoT Device Processing Using MQTT, Node-RED, and OCI Streaming](https://www.youtube.com/watch?v=NfD4UTA0oh8) +- [Airport Chatbot with OCI, AI and Open-Source services](https://www.youtube.com/watch?v=rs-RtvtKkpg) + +# Useful Links - [OCI Streaming Documentation](https://docs.oracle.com/en-us/iaas/Content/Streaming/Concepts/streamingoverview.htm) - [Overview of OCI Streaming - YouTube](https://www.youtube.com/watch?v=G8-E_j-uVak) # Reusable Assets +- [LiveLabs: Deploying OCI Streaming Service](https://apexapps.oracle.com/pls/apex/f?p=133:180:107188281482541::::wid:664) +- [LiveLabs: How do I ingest messages into OCI streaming in real-time with Oracle GoldenGate for Big Data?](https://apexapps.oracle.com/pls/apex/r/dbpm/livelabs/run-workshop?p210_wid=3572&session=107188281482541) -- [Revival of the Magical Suitcase](https://medium.com/@devpiotrekk/revival-of-the-magical-suitcase-73093af23f29) - -- [Fake Producer and Consumer for OCI Streaming](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-streaming/code-examples/fake-producer-consumer) - -- [Create and run Mosquitto & Node-RED, connecting to OCI Streaming](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-streaming/code-examples/mosquitto_node-red) # License