Oracle® Streams Concepts and Administration 10g Release 1 (10.1) Part No. B10727-01 December 2003 Oracle Streams Concepts and Administration, 10g Release 1 (10.1) Part No. B10727-01 Copyright © 2002, 2003 Oracle Corporation. All rights reserved. Primary Author: Randy Urbano Graphic Artist: Valarie Moore Contributors: Sundeep Abraham, Nimar Arora, Lance Ashdown, Ram Avudaiappan, Sukanya Balaraman, Neerja Bhatt, Ragamayi Bhyravabhotla, Chipper Brown, Diego Cassinera, Debu Chatterjee, Jack Chung, Alan Downing, Lisa Eldridge, Curt Elsbernd, Yong Feng, Jairaj Galagali, Brajesh Goyal, Connie Green, Sanjay Kaluskar, Lewis Kaplan, Joydip Kundu, Anand Lakshminath, Jing Liu, Edwina Lu, Raghu Mani, Pat McElroy, Krishnan Meiyyappan, Shailendra Mishra, Tony Morales, Bhagat Nainani, Anand Padmanaban, Maria Pratt, Arvind Rajaram, Viv Schupmann, Vipul Shah, Neeraj Shodhan, Wayne Smith, Benny Souder, Jim Stamos, Janet Stern, Mahesh Subramaniam, Kapil Surlaker, Bob Thome, Hung Tran, Ramkumar Venkatesan, Byron Wang, Wei Wang, James M. Wilson, Lik Wong, David Zhang The Programs (which include both the software and documentation) contain proprietary information of Oracle Corporation; they are provided under a license agreement containing restrictions on use and disclosure and are also protected by copyright, patent and other intellectual and industrial property laws. Reverse engineering, disassembly or decompilation of the Programs, except to the extent required to obtain interoperability with other independently created software or as specified by law, is prohibited. The information contained in this document is subject to change without notice. If you find any problems in the documentation, please report them to us in writing. Oracle Corporation does not warrant that this document is error-free. Except as may be expressly permitted in your license agreement for these Programs, no part of these Programs may be reproduced or transmitted in any form or by any means, electronic or mechanical, for any purpose, without the express written permission of Oracle Corporation. If the Programs are delivered to the U.S. Government or anyone licensing or using the programs on behalf of the U.S. Government, the following notice is applicable: Restricted Rights Notice Programs delivered subject to the DOD FAR Supplement are "commercial computer software" and use, duplication, and disclosure of the Programs, including documentation, shall be subject to the licensing restrictions set forth in the applicable Oracle license agreement. Otherwise, Programs delivered subject to the Federal Acquisition Regulations are "restricted computer software" and use, duplication, and disclosure of the Programs shall be subject to the restrictions in FAR 52.227-19, Commercial Computer Software - Restricted Rights (June, 1987). Oracle Corporation, 500 Oracle Parkway, Redwood City, CA 94065. The Programs are not intended for use in any nuclear, aviation, mass transit, medical, or other inherently dangerous applications. It shall be the licensee's responsibility to take all appropriate fail-safe, backup, redundancy, and other measures to ensure the safe use of such applications if the Programs are used for such purposes, and Oracle Corporation disclaims liability for any damages caused by such use of the Programs. Oracle is a registered trademark, and Oracle9i, Oracle Store, SQL*Plus, and PL/SQL are trademarks or registered trademarks of Oracle Corporation. Other names may be trademarks of their respective owners. iii Contents Send Us Your Comments xvii Preface xix Audience xx Organization xx Related Documentation xxiii Conventions xxv Documentation Accessibility xxviii What's New in Oracle Streams? xxix Streams Performance Improvements xxx Streams Configuration and Manageability Enhancements xxx Streams Replication Enhancements xxxvii Streams Messaging Enhancements xlii Rules Interface Enhancements xliv Part I Streams Concepts 1 Introduction to Streams Overview of Streams 1-2 What Can Streams Do? 1-3 What Are the Uses of Streams? 1-4 Overview of the Capture Process 1-7 iv Overview of Event Staging and Propagation 1-9 Overview of Directed Networks 1-9 Explicit Enqueue and Dequeue of Events 1-10 Overview of the Apply Process 1-12 Overview of the Messaging Client 1-13 Overview of Automatic Conflict Detection and Resolution 1-14 Overview of Rules 1-14 Overview of Transformations 1-16 Overview of Streams Tags 1-17 Overview of Heterogeneous Information Sharing 1-17 Overview of Oracle to Non-Oracle Data Sharing 1-18 Overview of Non-Oracle to Oracle Data Sharing 1-19 Example Streams Configurations 1-20 Administration Tools for a Streams Environment 1-22 Oracle-Supplied PL/SQL Packages 1-22 Streams Data Dictionary Views 1-24 Streams Tool in the Oracle Enterprise Manager Console 1-24 2 Streams Capture Process The Redo Log and a Capture Process 2-2 Logical Change Records (LCRs) 2-2 Row LCRs 2-3 DDL LCRs 2-5 Extra Information in LCRs 2-6 Capture Process Rules 2-7 Datatypes Captured 2-8 Types of Changes Captured 2-10 Types of DML Changes Captured 2-10 Types of DDL Changes Ignored by a Capture Process 2-12 Other Types of Changes Ignored by a Capture Process 2-13 NOLOGGING and UNRECOVERABLE Keywords for SQL Operations 2-13 UNRECOVERABLE Clause for Direct Path Loads 2-14 Supplemental Logging in a Streams Environment 2-15 Instantiation in a Streams Environment 2-15 v Local Capture and Downstream Capture 2-17 Local Capture 2-17 Downstream Capture 2-19 SCN Values Relating to a Capture Process 2-23 Captured SCN and Applied SCN 2-24 First SCN and Start SCN 2-24 Streams Capture Processes and RESTRICTED SESSION 2-26 Streams Capture Processes and Oracle Real Application Clusters 2-27 Capture Process Architecture 2-28 Capture Process Components 2-29 Capture Process States 2-30 Multiple Capture Processes in a Single Database 2-31 Capture Process Checkpoints 2-31 Capture Process Creation 2-32 A New First SCN Value and Purged LogMiner Dictionary Information 2-44 The Streams Data Dictionary 2-45 ARCHIVELOG Mode and a Capture Process 2-46 Capture Process Parameters 2-47 Capture Process Rule Evaluation 2-49 Persistent Capture Process Status Upon Database Restart 2-52 3 Streams Staging and Propagation Introduction to Event Staging and Propagation 3-2 Captured and User-Enqueued Events 3-3 Event Propagation Between Queues 3-5 Propagation Rules 3-5 Ensured Event Delivery 3-6 Directed Networks 3-7 Binary File Propagation 3-11 Messaging Clients 3-11 SYS.AnyData Queues and User Messages 3-12 SYS.AnyData Queues and Oracle Real Application Clusters 3-14 Streams Staging and Propagation Architecture 3-16 Buffered Queues 3-16 Propagation Jobs 3-17 vi Secure Queues 3-19 Transactional and Nontransactional Queues 3-22 Streams Data Dictionary for Propagations 3-23 4 Streams Apply Process Introduction to the Apply Process 4-2 Apply Process Rules 4-2 Event Processing with an Apply Process 4-3 Processing Captured and User-Enqueued Events with an Apply Process 4-3 Event Processing Options with an Apply Process 4-4 Datatypes Applied 4-11 Streams Apply Processes and RESTRICTED SESSION 4-12 Streams Apply Processes and Oracle Real Application Clusters 4-13 Apply Process Architecture 4-14 Apply Process Components 4-14 Apply Process Creation 4-17 Streams Data Dictionary for an Apply Process 4-18 Apply Process Parameters 4-19 Persistent Apply Process Status Upon Database Restart 4-22 The Error Queue 4-22 5 Rules The Components of a Rule 5-2 Rule Condition 5-2 Rule Evaluation Context 5-6 Rule Action Context 5-10 Rule Set Evaluation 5-13 Rule Set Evaluation Process 5-14 Partial Evaluation 5-15 Database Objects and Privileges Related to Rules 5-17 Privileges for Creating Database Objects Related to Rules 5-18 Privileges for Altering Database Objects Related to Rules 5-18 Privileges for Dropping Database Objects Related to Rules 5-19 vii Privileges for Placing Rules in a Rule Set 5-19 Privileges for Evaluating a Rule Set 5-20 Privileges for Using an Evaluation Context 5-20 6 How Rules Are Used In Streams Overview of How Rules Are Used In Streams 6-2 Rule Sets and Rule Evaluation of Events 6-4 Streams Client With No Rule Set 6-5 Streams Client With a Positive Rule Set Only 6-5 Streams Client With a Negative Rule Set Only 6-5 Streams Client With Both a Positive and a Negative Rule Set 6-5 Streams Client With One or More Empty Rule Sets 6-6 Summary of Rule Sets and Streams Client Behavior 6-6 System-Created Rules 6-7 Global Rules 6-14 Schema Rules 6-18 Table Rules 6-20 Subset Rules 6-23 Message Rules 6-36 System-Created Rules and Negative Rule Sets 6-39 System-Created Rules with Added User-Defined Conditions 6-44 Evaluation Contexts Used in Streams 6-45 Evaluation Context for Global, Schema, Table, and Subset Rules 6-45 Evaluation Contexts for Message Rules 6-48 Streams and Event Contexts 6-50 Streams and Action Contexts 6-50 Purposes of Action Contexts in Streams 6-50 Make Sure Only One Rule Can Evaluate to TRUE for a Particular Rule Condition 6-52 Action Context Considerations for Schema and Global Rules 6-53 User-Created Rules, Rule Sets, and Evaluation Contexts 6-54 User-Created Rules and Rule Sets 6-54 User-Created Evaluation Contexts 6-63 Rule-Based Transformations 6-63 Rule-Based Transformations and a Capture Process 6-67 Rule-Based Transformations and a Propagation 6-69 viii Rule-Based Transformations and an Apply Process 6-71 Rule-Based Transformations and a Messaging Client 6-74 Multiple Rule-Based Transformations 6-75 7 Streams High Availability Environments Overview of Streams High Availability Environments 7-2 Protection from Failures 7-2 Streams Replica Database 7-3 When Not to Use Streams 7-5 Application Maintained Copies 7-6 Best Practices for Streams High Availability Environments 7-6 Configuring Streams for High Availability 7-7 Recovering from Failures 7-9 Part II Streams Administration 8 Preparing a Streams Environment Configuring a Streams Administrator 8-2 Setting Initialization Parameters Relevant to Streams 8-6 Preparing a Database to Run a Streams Capture Process 8-11 Configuring Network Connectivity and Database Links 8-11 9 Managing a Capture Process Creating a Capture Process 9-2 Creating a Local Capture Process 9-4 Creating a Downstream Capture Process That Assigns Log Files Implicitly 9-6 Creating a Downstream Capture Process That Assigns Log Files Explicitly 9-18 Creating a Local Capture Process with Non-NULL Start SCN 9-23 Starting, Stopping, and Dropping a Capture Process 9-25 Starting a Capture Process 9-26 Stopping a Capture Process 9-26 Dropping a Capture Process 9-26 ix Managing the Rule Set for a Capture Process 9-27 Specifying a Rule Set for a Capture Process 9-27 Adding Rules to a Rule Set for a Capture Process 9-28 Removing a Rule from a Rule Set for a Capture Process 9-30 Removing a Rule Set for a Capture Process 9-31 Setting a Capture Process Parameter 9-32 Setting the Capture User for a Capture Process 9-32 Specifying Supplemental Logging at a Source Database 9-33 Adding an Archived Redo Log File to a Capture Process Explicitly 9-33 Setting SCN Values for an Existing Capture Process 9-34 Setting the First SCN for an Existing Capture Process 9-34 Setting the Start SCN for an Existing Capture Process 9-36 Specifying Whether Downstream Capture Uses a Database Link 9-37 Managing Extra Attributes in Captured LCRs 9-38 Including Extra Attributes in Captured LCRs 9-39 Excluding Extra Attributes from Captured LCRs 9-39 10 Managing Staging and Propagation Managing SYS.AnyData Queues 10-2 Creating a SYS.AnyData Queue 10-2 Enabling a User to Perform Operations on a Secure Queue 10-3 Disabling a User from Performing Operations on a Secure Queue 10-5 Removing a SYS.AnyData Queue 10-6 Managing Streams Propagations and Propagation Jobs 10-7 Creating a Propagation 10-8 Enabling a Propagation Job 10-11 Scheduling a Propagation Job 10-12 Altering the Schedule of a Propagation Job 10-12 Unscheduling a Propagation Job 10-13 Specifying the Rule Set for a Propagation 10-14 Specifying a Positive Rule Set for a Propagation 10-14 Specifying a Negative Rule Set for a Propagation 10-15 Adding Rules to the Rule Set for a Propagation 10-15 Removing a Rule from the Rule Set for a Propagation 10-17 Removing a Rule Set for a Propagation 10-18 x Disabling a Propagation Job 10-18 Dropping a Propagation 10-19 Managing a Streams Messaging Environment 10-20 Wrapping User Message Payloads in a SYS.AnyData Wrapper and Enqueuing Them 10-20 Dequeuing a Payload That Is Wrapped in a SYS.AnyData Payload 10-23 Configuring a Messaging Client and Message Notification 10-25 11 Managing an Apply Process Creating, Starting, Stopping, and Dropping an Apply Process 11-2 Creating an Apply Process 11-2 Starting an Apply Process 11-10 Stopping an Apply Process 11-10 Dropping an Apply Process 11-10 Managing the Rule Set for an Apply Process 11-11 Specifying the Rule Set for an Apply Process 11-11 Adding Rules to the Rule Set for an Apply Process 11-12 Removing a Rule from the Rule Set for an Apply Process 11-14 Removing a Rule Set for an Apply Process 11-15 Setting an Apply Process Parameter 11-16 Setting the Apply User for an Apply Process 11-17 Managing the Message Handler for an Apply Process 11-17 Setting the Message Handler for an Apply Process 11-18 Removing the Message Handler for an Apply Process 11-18 Managing the Precommit Handler for an Apply Process 11-18 Creating a Precommit Handler for an Apply Process 11-18 Setting the Precommit Handler for an Apply Process 11-20 Removing the Precommit Handler for an Apply Process 11-21 Specifying Event Enqueues by Apply Processes 11-21 Setting the Destination Queue for Events That Satisfy a Rule 11-21 Removing the Destination Queue Setting for a Rule 11-22 Specifying Execute Directives for Apply Processes 11-23 Specifying That Events That Satisfy a Rule Are Not Executed 11-23 Specifying That Events That Satisfy a Rule Are Executed 11-24 [...]... these Oracle resources: I Oracle Streams Replication Administrator's Guide I Oracle Database Concepts I Oracle Database Administrator's Guide I Oracle Database SQL Reference I PL/SQL Packages and Types Reference xxiii I PL/SQL User's Guide and Reference I Oracle Database Utilities I Oracle Database Heterogeneous Connectivity Administrator's Guide I Oracle Streams Advanced Queuing User's Guide and Reference... number, and (optionally) electronic mail address I If you have problems with the software, please contact your local Oracle Support Services xvii xviii Preface Oracle Streams Concepts and Administration describes the features and functionality of Streams This document contains conceptual information about Streams, along with information about managing a Streams environment In addition, this document... Export/Import and Streams Performing the Maintenance Operation Using RMAN and Streams Finishing the Database Maintenance Operation B-2 B-3 B-4 B-8 B-14 B-14 B-15 B-16 B-20 B-28 Index xv xvi Send Us Your Comments Oracle Streams Concepts and Administration, 10g Release 1 (10.1) Part No B10727-01 Oracle Corporation welcomes your comments and suggestions on the quality and usefulness of this document... What's New in Oracle Streams? This section describes new features of Oracle Streams for Oracle Database 10g Release 1 (10.1) and provides pointers to additional information where appropriate The following sections describe the new features in Oracle Streams: I Streams Performance Improvements I Streams Configuration and Manageability Enhancements I Streams Replication Enhancements I Streams Messaging... contains detailed examples that configure a Streams capture and apply environment and a rule-based application This preface contains these topics: I Audience I Organization I Related Documentation I Conventions I Documentation Accessibility xix Audience Oracle Streams Concepts and Administration is intended for database administrators who create and maintain Streams environments These administrators... Also: I I "Streams Capture Processes and Oracle Real Application Clusters" on page 2-27 "Streams Apply Processes and Oracle Real Application Clusters" on page 4-13 Support for Function-Based Indexes and Descending Indexes Streams capture processes and apply processes now support processing changes to tables that use function-based indexes and descending indexes Simpler Removal of Rule Sets When a Streams. .. 12-25 12-27 Other Streams Management Tasks Performing Full Database Export/Import in a Streams Environment 13-2 Removing a Streams Configuration 13-7 xi 14 Monitoring a Streams Environment Summary of Streams Static Data Dictionary Views Summary of Streams Dynamic Performance Views Monitoring Streams Administrators and Other Streams Users Listing Local Streams Administrators... Oracle Streams Advanced Queuing User's Guide and Reference I Streams online help for the Streams tool in Oracle Enterprise Manager You may find more information about a particular topic in the other documents in the Oracle documentation set Oracle error message documentation is only available in HTML If you only have access to the Oracle Documentation CD, you can browse the error messages by range... I Plan for a Streams environment I Configure a Streams environment I Administer a Streams environment I Monitor a Streams environment I Perform necessary troubleshooting activities To use this document, you need to be familiar with relational database concepts, SQL, distributed database administration, Advanced Queuing concepts, PL/SQL, and the operating systems under which you run a Streams environment... This document contains: Part I, "Streams Concepts" Contains chapters that describe conceptual information relating to Streams Chapter 1, "Introduction to Streams" Introduces the major features of Streams and how they can be used Chapter 2, "Streams Capture Process" Contains conceptual information about the Streams capture process Includes information about logical change records (LCRs), datatypes and . Oracle Streams Concepts and Administration 10g Release 1 (10.1) Part No. B10727-01 December 2003 Oracle Streams Concepts and Administration, . local Oracle Support Services. xviii xix Preface Oracle Streams Concepts and Administration describes the features and functionality of Streams. This document