Diagram generation: ref-arch-driven procedure + spec validator + KB enrichment

The diagram path now follows a documented standard procedure (lookup
the closest Oracle Architecture Center reference → confirm components
→ author absolute_layout → spec validator → render → visually verify)
and ships persistent guardrails so layout regressions can't recur.

Persistent procedure changes (apply to all users, all sessions):
- tools/diagram_spec_validator.py — geometry checks (CONTAINER_TOO_THIN,
  CONTAINER_PADDING_VIOLATION, LABEL_OVERFLOW_PARENT) run BEFORE either
  renderer (drawio + PPTX). Catches the subnet-collapse / label-overflow
  bugs that the post-render drawio validator missed.
- tools/oci_diagram_gen.py + tools/oci_pptx_diagram_gen.py — call the
  spec validator before emitting any output. Adds mysql / mysql_heatwave
  type aliases.
- tools/archcenter_pattern_lookup.py — scores against cached page
  descriptions (not just the 1-line summary), supports --queries for
  multi-fragment composition, and applies synonym expansion via
  kb/architecture-center/synonyms.yaml so "LB HA cross AD" matches
  "load balancer high availability availability domain".
- kb/architecture-center/synonyms.yaml — canonical synonym table
  (load balancer, autonomous database, data guard, …) used by the
  lookup scorer.

KB enrichment:
- tools/archcenter_description_fetcher.py + 121 cached _description.md
  under kb/diagram/assets/archcenter-refs/<slug>/. Removes the runtime
  dependency on docs.oracle.com when authoring specs and feeds the
  pattern-lookup scorer.
- 110+ cached .drawio / .svg / .png references for offline reuse,
  plus the OCI Toolkit v24.2 import (kb/diagram/assets/oci-toolkit-drawio).

Documentation:
- docs/skill/output-formats.md — new "Standard diagram-generation
  procedure (MANDATORY)" + geometry rules + the new validator entry.
- SKILL.md option 2 — references the mandatory procedure.
- README.md — describes the spec validator, archcenter_pattern_lookup
  and description fetcher, and updates the KB-health table.

Tooling that backs the procedure (cumulative across recent sessions):
tools/archcenter_case_runner.py, archcenter_batch_driver.py,
archcenter_zip_downloader.py, drawio_visual_validator.py,
drawio_fidelity_eval.py, harvest_drawio_icon.py, import_oci_library.py,
oci_pptx_diagram_gen.py, oci_pptx_render.py, refresh_pptx_icon_index.py.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
root
2026-04-25 21:15:21 -03:00
parent 2491c38d4b
commit b30a4f0d32
635 changed files with 365317 additions and 1014 deletions

View File

@@ -0,0 +1,236 @@
# Implement Oracle GoldenGate in Microsoft Azure with Oracle Database@Azure
- Source: https://docs.oracle.com/en/solutions/implement-goldengate-azure/index.html
- Date: 2024-10
- Type: reference-architecture
- Services: goldengate, exacs, azure
- Tags: database, multicloud, azure, integration
## Summary (catalog)
GoldenGate deployment patterns for Database@Azure. Real-time replication between on-premises and ExaCS, or between ExaCS instances across Azure regions.
## Architecture (fetched from source)
Architecture
This reference architecture implements Oracle GoldenGate running on Azure linux virtual machines, or containers hosted on Azure Kubernetes Service . Oracle GoldenGate has deep integration with Oracle Database@Azure for change data capture to facilitate organization to stay up-to-date with the latest
data in near real time and avoid relying on stale data.
Oracle GoldenGate empowers organizations to optimize their data management processes and facilitates
the seamless integration of data stored in Oracle Database@Azure into data lakes and lakehouses for advanced analytics and machine learning workloads.
You can build robust data streaming platforms on Azure , ensuring seamless data integration, scalability, and real-time analytics. Oracle GoldenGate provides data consistency and synchronization to make it an invaluable technology for
organizations striving to leverage real-time data to make informed decisions based on
accurate and timely data, driving the success of your business in the cloud-native era
and enhancing business operations.
The following diagram illustrates this reference architecture for an Oracle GoldenGate implementation hosted in Microsoft Azure for integration between Oracle Database@Azure and Azure native services for streaming, data processing, machine learning, and analytics. You
can leverage this reference architecture for reusing an existing Oracle GoldenGate implementation, or a fresh implementation for reasons like legal obligations, latency
sensitive workloads, and centralized data management.
The following diagram illustrates this reference architecture.
Description of the illustration goldengate-dbatazure-integration.png
goldengate-dbatazure-integration.zip
The architecture has the following components:
- Region
An Oracle Cloud
Infrastructure region is a localized geographic area that
contains one or more data centers, called
availability domains. Regions are independent of
other regions, and vast distances can separate
them (across countries or even
continents).
- On-premises network
This
network is the local network used by your
organization. It is one of the spokes of the
topology.
- Virtual cloud network (VCN) and subnets
A VCN is a customizable,
software-defined network that you set up in an Oracle Cloud
Infrastructure region. Like traditional data center networks,
VCNs give you control over your network
environment. A VCN can have multiple
non-overlapping CIDR blocks that you can change
after you create the VCN. You can segment a VCN
into subnets, which can be scoped to a region or
to an availability domain. Each subnet consists of
a contiguous range of addresses that don't overlap
with the other subnets in the VCN. You can change
the size of a subnet after creation. A subnet can
be public or private.
- VNIC
A virtual network
interface card (VNIC) enables an instance to
connect to a VCN and determines how the instance
connects with endpoints inside and outside the
VCN. Each VNIC resides in a subnet in a VCN and
includes these items:
- A primary private IPv4 address
from the subnet the VNIC is in, chosen by either
you or Oracle.
- Optional secondary private IPv4
addresses from the same subnet the VNIC is in,
chosen by either you or Oracle.
- An optional public IPv4 address
for each private IP, chosen by Oracle but assigned
by you at your discretion.
- An optional hostname for DNS for
each private IP address.
- A MAC address.
- A VLAN tag assigned by Oracle and
available when attachment of the VNIC to the
instance is complete (relevant only for bare metal
instances).
- A flag to enable or disable the
source/destination check on the VNIC's network
traffic.
- Optional membership in one or
more network security groups (NSGs) of your
choice. NSGs have security rules that apply only
to the VNICs in that NSG.
- Optional IPv6 addresses. IPv6
addressing is supported for all commercial and
government regions.
- Object storage
Oracle Cloud
Infrastructure Object Storage provides quick access to large
amounts of structured and unstructured data of any
content type, including database backups, analytic
data, and rich content such as images and videos.
You can safely and securely store and then
retrieve data directly from the internet or from
within the cloud platform. You can scale storage
without experiencing any degradation in
performance or service reliability. Use standard
storage for "hot" storage that you need to access
quickly, immediately, and frequently. Use archive
storage for "cold" storage that you retain for
long periods of time and seldom or rarely
access.
- Oracle GoldenGate
Oracle GoldenGate is an application that provides real-time data integration, data replication,
transactional change data capture, data transformations, high availability
solutions, and verification between operational and analytical enterprise
systems. This architecture consists of running Oracle GoldenGate on Linux Virtual Machine or Azure Kubernetes Service.
- Oracle Database@Azure
Oracle Database@Azure integrates Oracle Exadata Database
Service , Oracle Real Application Clusters (Oracle RAC),
and Oracle Data Guard technologies into the Azure
platform. Oracle Database@Azure service offers the same low latency as other
Azure-native services and meets mission-critical
workloads and cloud-native development needs.
Users manage the service on the Azure console and
with Azure automation tools. The service is
deployed in Azure Virtual Network (VNet) and
integrated with the Azure identity and access
management system. The OCI and Oracle Database
metrics and audit logs are natively available in
Azure. The service requires users to have an Azure
tenancy and an OCI tenancy. Oracle Autonomous Database Serverless is also available with Oracle Database@Azure as the worlds first autonomous data
management, fully managed in the cloud, to deliver
automated patching, upgrades, and tuning, without
human intervention. Autonomous Database is built on Oracle Exadata infrastructure, is
self-managing, self-securing, and self-repairing,
helping eliminate manual database management and
human errors. Autonomous Database enables development of scalable AI-powered apps
with any data using built-in AI capabilities using
your choice of large language model (LLM) and
deployment location.
- Oracle Autonomous Database Serverless
Oracle Autonomous Database is the worlds first autonomous data management, fully managed in the cloud,
to deliver automated patching, upgrades, and tuning, without human intervention.
Autonomous Database is built on Oracle Exadata infrastructure, is self-managing,
self-securing, and self-repairing, helping eliminate manual database management
and human errors. Autonomous Database enables development of scalable AI-powered
apps with any data using built-in AI capabilities using your choice of large
language model (LLM) and deployment location.
- Oracle Exadata Database Service on Dedicated
Infrastructure
Oracle Exadata Database Service on Dedicated
Infrastructure provides Oracle Exadata Database Machine as a service in an Oracle Cloud
Infrastructure (OCI) data center. The Oracle Exadata Database Service on Dedicated
Infrastructure instance is a virtual machine (VM) cluster that
resides on Exadata racks in an OCI region.
Oracle Exadata Database
Service delivers proven Oracle Database capabilities on purpose-built, optimized Oracle Exadata infrastructure in the
public cloud. Built-in cloud automation, elastic resource scaling, security, and
fast performance for OLTP, in-memory analytics, and converged Oracle Database workloads help simplify management and reduce costs.
The architecture has the following Azure components:
- Azure Virtual Network (VNet)
Azure Virtual Netw

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 130 KiB

View File

@@ -0,0 +1,7 @@
The diagram you downloaded is available in these formats:
- DRAWIO
- SVG
You can customize them for your organization using the associated tools:
- For DRAWIO format, use draw.io for Confluence, online at diagrams.net, or the desktop app. Go to diagrams.net for more information.
- For SVG format, use an SVG editor such as Inkscape or Sketsa SVG Editor, which are free and available for Windows, macOS, Linux.