Deliver continuous access to timely and accurate BI across your enterpriseusing the detailed information in this Oracle Press guide. Through clear explanations and practical examples, a team of Oracle expertsshows how to assimilate data from disparate sources into a single, unified view. Find out how to transform data in real time, handle replication and migration, and deploy Oracle Data Integrator and Oracle GoldenGate.Oracle Data Integration: Tools for Harnessing Data offers complete coverage of the latest “big data” hardware and software solutions.
· Efficiently move data both inside and outside an Oracle environment
· Map sources to database fields using Data Merge and ETL
· Export schema through transportable tablespaces and Oracle Data Pump
· Capture and apply changes across heterogeneous systems with Oracle GoldenGate
· Seamlessly exchange information between databases using Oracle Data Integrator
· Correct errors and maximize quality through data cleansing and validation
· Plan and execute successful Oracle Database migrations and replications
· Handle high-volume transactions with Oracle Big Data Appliance, Oracle NoSQL, and third-party utilities
| Acknowledgments |
|
xvii | |
| Introduction |
|
xix | |
|
1 Data Integrations Overview |
|
|
1 | (16) |
|
What Is a Data Integration? |
|
|
3 | (1) |
|
History of Data Integration |
|
|
4 | (2) |
|
|
|
6 | (5) |
|
|
|
11 | (2) |
|
Tools for Harnessing Data |
|
|
13 | (1) |
|
|
|
14 | (3) |
|
2 Moving Data Around the Oracle Environment |
|
|
17 | (36) |
|
Structured Query Language |
|
|
19 | (14) |
|
|
|
19 | (4) |
|
Data Manipulation Language |
|
|
23 | (8) |
|
|
|
31 | (2) |
|
|
|
33 | (1) |
|
|
|
33 | (1) |
|
|
|
33 | (8) |
|
|
|
34 | (2) |
|
|
|
36 | (1) |
|
|
|
37 | (1) |
|
|
|
38 | (3) |
|
|
|
41 | (2) |
|
|
|
43 | (2) |
|
|
|
45 | (5) |
|
|
|
45 | (4) |
|
Dealing with the Bad File |
|
|
49 | (1) |
|
|
|
49 | (1) |
|
|
|
50 | (2) |
|
|
|
52 | (1) |
|
|
|
53 | (34) |
|
|
|
54 | (4) |
|
|
|
58 | (2) |
|
|
|
60 | (4) |
|
|
|
64 | (5) |
|
Invoking Export from the Command Line |
|
|
65 | (1) |
|
Invoking Export Interactively from the Command Line |
|
|
65 | (2) |
|
Invoking Export via Parameter Files |
|
|
67 | (2) |
|
|
|
69 | (3) |
|
Transportable Tablespaces |
|
|
72 | (3) |
|
Pluggable Databases and Transport Databases |
|
|
75 | (1) |
|
|
|
76 | (3) |
|
|
|
79 | (1) |
|
|
|
79 | (3) |
|
|
|
82 | (1) |
|
|
|
83 | (2) |
|
|
|
83 | (1) |
|
|
|
84 | (1) |
|
|
|
85 | (2) |
|
4 Oracle Replication (GoldenGate) |
|
|
87 | (26) |
|
Oracle GoldenGate Use-Cases |
|
|
88 | (3) |
|
|
|
89 | (1) |
|
|
|
89 | (1) |
|
Data Distribution Use-Case |
|
|
90 | (1) |
|
Near-Zero-Downtime Migration |
|
|
90 | (1) |
|
Oracle GoldenGate Architecture |
|
|
91 | (4) |
|
Capture (Extract) Process |
|
|
92 | (2) |
|
Data Pump (Extract) Process |
|
|
94 | (1) |
|
|
|
94 | (1) |
|
|
|
95 | (1) |
|
Transforming Data on the Fly with Oracle GoldenGate |
|
|
95 | (4) |
|
|
|
96 | (2) |
|
|
|
98 | (1) |
|
Using Oracle GoldenGate to Create Flat Files |
|
|
99 | (5) |
|
|
|
100 | (1) |
|
|
|
100 | (2) |
|
Generating an ASCII-Formatted File |
|
|
102 | (2) |
|
Using Oracle GoldenGate to Create Native Database Loader Files |
|
|
104 | (2) |
|
Extracting for Database Utility Usage |
|
|
105 | (1) |
|
Oracle GoldenGate User Exit Functions |
|
|
106 | (1) |
|
Testing Data with Oracle GoldenGate |
|
|
107 | (4) |
|
|
|
109 | (2) |
|
|
|
111 | (2) |
|
|
|
113 | (66) |
|
|
|
114 | (4) |
|
|
|
115 | (1) |
|
|
|
116 | (1) |
|
|
|
117 | (1) |
|
Oracle Data Integrator Console |
|
|
118 | (1) |
|
|
|
118 | (23) |
|
|
|
118 | (6) |
|
|
|
124 | (9) |
|
|
|
133 | (1) |
|
Configuring the ODI Agent |
|
|
134 | (7) |
|
Starting Oracle Data Integrator |
|
|
141 | (6) |
|
|
|
142 | (1) |
|
Initial Connection and Wallet Configuration |
|
|
143 | (4) |
|
|
|
147 | (6) |
|
|
|
147 | (4) |
|
|
|
151 | (2) |
|
|
|
153 | (13) |
|
|
|
159 | (7) |
|
|
|
166 | (6) |
|
|
|
167 | (5) |
|
|
|
172 | (4) |
|
|
|
174 | (1) |
|
|
|
175 | (1) |
|
Validating That the Data Has Been Integrated |
|
|
176 | (1) |
|
|
|
177 | (2) |
|
|
|
179 | (26) |
|
|
|
180 | (22) |
|
|
|
181 | (3) |
|
|
|
184 | (3) |
|
|
|
187 | (2) |
|
|
|
189 | (1) |
|
|
|
190 | (2) |
|
Synchronizing Data and Copies: Multiple Systems |
|
|
192 | (2) |
|
|
|
194 | (1) |
|
|
|
195 | (3) |
|
Managing Mapping Tables: Metadata |
|
|
198 | (2) |
|
|
|
200 | (1) |
|
|
|
201 | (1) |
|
|
|
202 | (3) |
|
|
|
205 | (28) |
|
|
|
206 | (2) |
|
|
|
208 | (13) |
|
|
|
209 | (4) |
|
|
|
213 | (4) |
|
|
|
217 | (4) |
|
|
|
221 | (4) |
|
|
|
225 | (5) |
|
|
|
230 | (3) |
|
|
|
233 | (16) |
|
Oracle Big Data Appliance |
|
|
236 | (4) |
|
|
|
237 | (1) |
|
|
|
237 | (1) |
|
|
|
238 | (1) |
|
|
|
238 | (1) |
|
|
|
238 | (1) |
|
Oracle SQL Connector for Hadoop |
|
|
239 | (1) |
|
|
|
240 | (1) |
|
|
|
240 | (2) |
|
Hadoop Distributed File System |
|
|
241 | (1) |
|
|
|
242 | (1) |
|
|
|
242 | (2) |
|
|
|
244 | (1) |
|
|
|
244 | (3) |
|
Oracle Data Integrator and Big Data |
|
|
244 | (2) |
|
Oracle GoldenGate and Big Data |
|
|
246 | (1) |
|
|
|
247 | (2) |
| Index |
|
249 | |
IOUG Board of Directors President and DBA Team Lead, DRW Holdings Michelle is an Oracle ACE Director and the DBA Team Lead at DRW Holdings in Chicago, with several years experience in database development, design and administration. She has expertise in security, performance tuning, data modeling and database architecture of very large database environments. When she is not applying CPU patches or securing her own company's databases, she writes articles and gives presentations on security and compliance topics as well as other database administrative areas such as RAC, ASM and recovery. She is also a contributing author for multiple books including the IOUG Best Practices Tip Booklet. She has been very involved in the IOUG, and is currently serving as president on the Board of Directors.
Bobby Curtis is an Oracle ACE, Senior Technical Consultant and member of various Oracle User Groups. He specializes in database monitoring and data integration technologies, both aimed at making usability simpler and easier. He is experienced in creating, managing and tuning enterprise databases including Exadata, GoldenGate replication and is known for his work with Oracle Enterprise Manager 12c. He is currently working as a Senior Technical Consultant focused on implementations and migrations of scalable databases while providing monitoring solutions for these environments. He is either a lead author or co-author on various technical books, published various technical articles in user group publications, and presented at conferences including Oracle Open World, Collaborate and KSCOPE. Bobby is a current member of the Independent Oracle User Group (IOUG), Oracle Development Tools User Group (ODTUG), Georgia Oracle User Group (GOUSER) and the Rocky Mountains Oracle User Group (RMOUG). He lives with his wife and three kids in Douglasville, GA. Bobby can be followed on twitter at @dbasolved and his blog at http://dbasolved.com.
Chris Lawless began his career in data integration by working in support for GoldenGate. He then worked in consulting and pre-sales prior to becoming a Product Manager at GoldenGate. When GoldenGate was acquired by Oracle he became a Product Manager in the Data Integration Group at Oracle for the next four years. Prior to working at GoldenGate Chris was a DBA instructor at Oracle University. Chris is currently a Product Manager at Dbvist Software, a replication company.
Lisainfo e-raamatute kohta