Skip to content

3.1.3 merge into master #14

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 83 commits into from
Jul 9, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
83 commits
Select commit Hold shift + click to select a range
4e0ccb1
bke is now developing for 3.1.3
bengsig Mar 7, 2024
b519bb3
Replace dbms_lock.sleep with dbms_session.sleep
bengsig Mar 12, 2024
4c02a8f
Save sql_id rather than a pointer to it
bengsig Mar 13, 2024
01792c7
$connecterror:accept directive
bengsig Mar 18, 2024
23b60c0
Connection storm (plus some doc updates)
bengsig Mar 20, 2024
7d66991
Prevent extra logon for reconnect databases
bengsig Mar 21, 2024
935640e
Fix storm graph
bengsig Mar 22, 2024
4233b21
Allow user to set everyuntil
bengsig Mar 25, 2024
0e79912
Document everyuntil can be set
bengsig Mar 26, 2024
9d3d5a1
Connection storm fixes and documentation
bengsig Mar 26, 2024
a681eb9
cstorm plots both by start/end of logon
bengsig Mar 27, 2024
32b94d1
Add ora 12510 to dead database errors
bengsig Apr 2, 2024
850915c
Add oltpping
bengsig Apr 2, 2024
e3ea458
Distinguish thread/xtra storm
bengsig Apr 3, 2024
d69efa9
Improve plot description
bengsig Apr 3, 2024
8da0aea
$oraerror:showoci directive
bengsig Apr 4, 2024
601b48e
Few missing grants/synonyms
bengsig Apr 5, 2024
7a1abb4
New aw_cols skew calculation
bengsig Apr 8, 2024
38744c1
printf k and K specifiers
bengsig Apr 9, 2024
8c2ff5d
Fix a few printf k/K format issues
bengsig Apr 9, 2024
b1edeab
Yet another printf k fix
bengsig Apr 9, 2024
619c4ac
Final fixes for k/K format
bengsig Apr 10, 2024
559fb38
Add end2end timing for mass insert
bengsig Apr 12, 2024
b416a82
Fix mtitplot e2e
bengsig Apr 12, 2024
35a9920
e2e is logscale
bengsig Apr 12, 2024
a856b4a
-= operator, clflags bits, nostatistics statement
bengsig Apr 17, 2024
5d8b58b
Elaborate on ?: being right associative
bengsig Apr 18, 2024
d97d252
Better adplot check
bengsig Apr 19, 2024
e081858
Use runseconds() as fucntion call in all documentation
bengsig Apr 24, 2024
0ee7b02
Gather sys/usr from gv$osstat
bengsig Apr 29, 2024
d39a8bf
Fix png files for osstat
bengsig Apr 29, 2024
1e31e26
Updating changelong and 3.1 news
bengsig May 1, 2024
b83989f
oltpplot --fractiles-dropped option
bengsig May 2, 2024
25f4cf0
$ampersand:on in histdata.rwl
bengsig May 2, 2024
2fd0528
Global osstat
bengsig May 8, 2024
5f39408
Add sys% usr% to global osstat graph
bengsig May 8, 2024
f965dfb
Add drop%
bengsig May 8, 2024
6afceb3
Fix < 1% drops
bengsig May 8, 2024
25aaeb0
Use exec in shell scripts
bengsig May 9, 2024
8084f43
Remove extra -= in rwldilex
bengsig May 10, 2024
948e9eb
$musymbolfromstring directive
bengsig May 10, 2024
700ff1d
Add xc_hardparse to aw_transaction and awindex_query
bengsig May 13, 2024
6a6a29a
Add keyring to doc, also gather PGA
bengsig May 17, 2024
dcdd58d
Memory plot is using logscale
bengsig May 21, 2024
381d63a
Add check for time difference
bengsig May 21, 2024
7009a27
Add checkepoch.rwl
bengsig May 21, 2024
668a325
Split long lines
bengsig May 22, 2024
39b4238
Lob trim before write
bengsig May 22, 2024
7b7d011
Fix full scan message
bengsig May 23, 2024
8219da4
Merge branch 'bkework' into 'oramain'
bengsig May 23, 2024
075d4d0
Improve some comments
bengsig May 27, 2024
d43602f
Changes to rwlparser.y
bengsig May 27, 2024
ffbecd3
Merge branch 'bkemain' into 'oramain'
bengsig May 27, 2024
59ecd24
Merge branch 'oramain' into 'bkemain'
bengsig May 28, 2024
41b4d73
Add another local only file
bengsig May 28, 2024
0b8a8f9
Enable compile in 23, disable 18
bengsig May 28, 2024
b0e5fc4
Use loadfactor with mtit
bengsig May 30, 2024
9722112
Add --fromminutes option to ashplot
bengsig May 30, 2024
c24040f
Comment
bengsig May 30, 2024
7c9889c
$ora01013:break directive
bengsig Jun 4, 2024
26879de
Running graphs in ashplot
bengsig Jun 4, 2024
fb5893e
Add oltpconnect
bengsig Jun 4, 2024
fba1bc4
Better RWL-322 description
bengsig Jun 4, 2024
6e6474a
Add -uno to git status to speed up rwlwatermark.sh
bengsig Jun 6, 2024
75b6851
Add (experimental) hcc table to mtit
bengsig Jun 10, 2024
db46f9b
Correct synonym
bengsig Jun 10, 2024
6e68b46
call exec rwloadsimNN via PATH rather than full pathname
bengsig Jun 13, 2024
c7ef5d9
Print proccount in mtitxcset
bengsig Jun 17, 2024
a85e6fd
Allow different index partition count for mtit
bengsig Jun 17, 2024
58b9091
Variable partition count
bengsig Jun 17, 2024
a4b5f7d
Make sure there is no ORA-00001 risk
bengsig Jun 18, 2024
58731a3
Modernize sqlmonitor, sqlreport; better tags in oltp
bengsig Jun 19, 2024
89b1426
Merge branch 'bkemain' into 'oramain'
bengsig Jun 26, 2024
886a2b2
Merge branch 'oramain' into 'bkemain'
bengsig Jun 26, 2024
9588cdc
no dropped in stead of 0% dropped
bengsig Jul 3, 2024
af09762
Fixed rwlreadlob
Jul 3, 2024
3f99b0b
Merge branch 'oramain' into 'obakhir'
bengsig Jul 3, 2024
e11fe2b
Merge branch 'obakhir' into 'oramain'
bengsig Jul 3, 2024
5926209
Merge branch 'oramain' into 'bkemain'
bengsig Jul 3, 2024
2ee6092
Changed end-to-end colors
bengsig Jul 3, 2024
1b01848
Add -2 option to oltpxcrun
bengsig Jul 4, 2024
6e39a16
Release 3.1.3
bengsig Jul 8, 2024
d53b0af
Merge branch 'bkemain' into 'oramain'
bengsig Jul 8, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@ lib/*.o
lib/*.obj
lib/*.lib
dist-rwl-bin.sh
dist-rwldev.sh
push_to_remotes.sh
make.generated.sh
*.tgz
Expand Down
15 changes: 12 additions & 3 deletions BUILDING.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,14 +3,14 @@
## Prerequisites

* An Oracle client environment (release 19.9 or higher) used for building the tool; Instant Client including basiclite, sdk and sqlplus is fine.
* Potentially client environments for other releases than the primary build release, these can similarly use full client or Instant Client; releases 11, 12, 18, 19, 21, 23 are supported.
* Potentially client environments for other releases than the primary build release, these can similarly use full client or Instant Client; releases 11, 12, 19, 21, 23 are supported.
* For client release 19, you must have at least 19.9.
* A database (release 19 or higher, release 21.3 preferred) that can be used to run test scripts.
* A database (release 19 or higher, release 21.9 preferred) that can be used to run test scripts.
* An environment with the gcc compiler and tools like make.
* Both bison (3.0.4 or newer) and flex must be installed.
* Installing ctags and cscope is recommended if you want to work on the source.
* The Bourne Again Shell, /bin/bash.
* Installing gnuplot is highly recommended, although not required for compiling or running test suite. It is required for running the oltp workload.
* Installing gnuplot is highly recommended, although not required for compiling or running test suite. It is required for running the oltp workload and several standard utilities
* On Solaris, you must have GNU utilities installed and they _must_ be before ordinary utilities in your PATH. Typically, this means your PATH should have /usr/gnu/bin among the first parts.

## Building rwloadsim
Expand Down Expand Up @@ -63,6 +63,15 @@ It contains a set of defines that must be provided for the new platform.
At present, the following platforms are in _Beta_ state, which means they are not yet ready for production use.
If you complete a port, please contact the rwloadsim developer.

### Microsoft Windows

For building on Microsoft Windows, you need the following:

* Microsoft Visual Studio 2017 or later
* nmake, cl, link (command line C compiler and linker)
* Oracle Instant client for Windows release 19.21 or newer
* For certain utilities (ashplot, ociping in concurrency mode), an installation of gnuplot is required

### Apple OS X

For building on OS X, please be aware of the following:
Expand Down
12 changes: 12 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,17 @@
# RWP\*Load Simulator Release Notes

## 3.1.3

* Bug fixes
* Printf format for KiB, MiB, etc
* Oltp workload can show connection storm effects
* Oltp workload can optionally query gv$osstat to usr/sys on db server
* The ashplot command can output a running graph
* Added -= assignment
* Various improvements to statistics gathering
* Client version 18 no longer supported
* Client version 23 now included

## 3.1.2

* Bug fixes
Expand Down
8 changes: 7 additions & 1 deletion admin/.vim/syntax/rwl.vim
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
" Copyright (c) 2023 Oracle Corporation
" Licensed under the Universal Permissive License v 1.0
" as shown at https://oss.oracle.com/licenses/upl/
" Latest Revision: 28 feb 2024
" Latest Revision: 4 jun 2024

if exists("b:current_syntax")
finish
Expand Down Expand Up @@ -94,6 +94,7 @@ syn region rwlSQL start='\<\ccreate[ \t\n]\+\(or[ \t\n]\+replace[ \t\n]\+\)\?pro
syn region rwlSQL start='\<\ccreate[ \t\n]\+\(or[ \t\n]\+replace[ \t\n]\+\)\?package[ \t\n]' end='\(^[ \t]*[/.]$\)'
syn region rwlSQL start='\<\ccreate[ \t\n]\+\(or[ \t\n]\+replace[ \t\n]\+\)\?library[ \t\n]' end='\(^[ \t]*[/.]$\)'

syn match rwlDirective '\$connecterror:accept'
syn match rwlDirective '\$statistics:basic'
syn match rwlDirective '\$statistics:histograms'
syn match rwlDirective '\$statistics:all'
Expand Down Expand Up @@ -140,6 +141,10 @@ syn match rwlDirective '\$maxmesg:\d\+'
syn match rwlDirective '\$readbuffer:\d\+'
syn match rwlDirective '\$ora01013:stop'
syn match rwlDirective '\$ora01013:continue'
syn match rwlDirective '\$ora01013:break'
syn match rwlDirective '\$ora01013:reset'
syn match rwlDirective '\$oraerror:showoci'
syn match rwlDirective '\$oraerror:noshowoci'
syn match rwlDirective '\$oraerror:stop'
syn match rwlDirective '\$oraerror:continue'
syn match rwlDirective '\$oraerror:nocount'
Expand Down Expand Up @@ -191,6 +196,7 @@ syn match rwlDirective '\$bindoutname:on'
syn match rwlDirective '\$bindoutname:on:[a-zA-Z][0-9a-zA-Z_]*'
syn match rwlDirective '\$bindoutname:off'
syn match rwlDirective '\$musymbol:[^ ][^ ]*'
syn match rwlDirective '\$musymbolfromstring:[a-zA-Z][a-zA-Z0-9_]*'
syn match rwlDirective '\$hostname:[a-zA-Z0-9_][-a-zA-Z0-9_\.]*'
syn match rwlDirective '\$slashconvert:on'
syn match rwlDirective '\$slashconvert:off'
Expand Down
36 changes: 36 additions & 0 deletions admin/rwl313.sql
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
-- update the RWP*Load Simulator repository
-- for version 3.1.3
--
-- Copyright (c) 2023 Oracle Corporation
-- Licensed under the Universal Permissive License v 1.0
-- as shown at https://oss.oracle.com/licenses/upl/
--
-- Changes
--
-- NAME DATE COMMENTS
--
-- bengsig 26-apr-2024 osstat
-- bengsig 19-mar-2024 Created
--
create table cstorm
( runnumber number not null
, threadnumber number not null
, begtime number
, endtime number
, offtime number
, errnum number
, errtxt varchar2(200)
, primary key(runnumber, threadnumber)
) ;

create table osstat
( runnumber number not null
, second number not null
, usr1 number(*,6), usr2 number(*,6), usr3 number(*,6), usr4 number(*,6)
, usr5 number(*,6), usr6 number(*,6), usr7 number(*,6), usr8 number(*,6)
, sys1 number(*,6), sys2 number(*,6), sys3 number(*,6), sys4 number(*,6)
, sys5 number(*,6), sys6 number(*,6), sys7 number(*,6), sys8 number(*,6)
, primary key(runnumber, second)
)
/

7 changes: 6 additions & 1 deletion admin/rwlgrants.sql
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,9 @@
-- as shown at https://oss.oracle.com/licenses/upl/

-- History
-- bengsig 26-apr-2024 - osstat
-- bengsig 5-apr-2023 - oltpxc
-- bengsig 19-mar-2023 - cstorm
-- bengsig 8-aug-2023 - Missing grant to PERSEC
-- bengsig 2017 - Creation

Expand Down Expand Up @@ -37,5 +40,7 @@ grant insert,select on SYSRES to rwlpublic;
grant insert,select on OERSTATS to rwlpublic;
grant insert,select on ashdata to rwlpublic;
grant insert,select on rwlash to rwlpublic;
grant insert,select on cstorm to rwlpublic;
grant insert,update,select on oltpxc to rwlpublic;
grant select on runnumber_seq to rwlpublic;

grant insert,select on osstat to rwlpublic;
26 changes: 26 additions & 0 deletions admin/rwloadsim.sql
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,8 @@
-- Changes
--
-- NAME DATE COMMENTS
-- bengsig 26-apr-2024 osstat table
-- bengsig 19-mar-2024 cstorm table
-- bengsig 1-mar-2024 atime,dtime column
-- bengsig 25-apr-2022 MTIT
-- bengsig 1-nov-2022 Make sequence nocache to prevent many lost numbers
Expand Down Expand Up @@ -192,3 +194,27 @@ create table oltpxc
, constraint oltpxc_pk primary key(key, hostname)
)
/

create table cstorm
( runnumber number not null
, threadnumber number not null
, begtime number
, endtime number
, offtime number
, errnum number
, errtxt varchar2(200)
, primary key(runnumber, threadnumber)
) ;

-- This table stores gv$sysstat values for USER_TIME and SYS_TIME
-- from up to 8 instances
create table osstat
( runnumber number not null
, second number not null
, usr1 number(*,6), usr2 number(*,6), usr3 number(*,6), usr4 number(*,6)
, usr5 number(*,6), usr6 number(*,6), usr7 number(*,6), usr8 number(*,6)
, sys1 number(*,6), sys2 number(*,6), sys3 number(*,6), sys4 number(*,6)
, sys5 number(*,6), sys6 number(*,6), sys7 number(*,6), sys8 number(*,6)
, primary key(runnumber, second)
)
/
6 changes: 5 additions & 1 deletion admin/rwlsynonyms.sql
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,8 @@
-- as shown at https://oss.oracle.com/licenses/upl/

-- History
-- bengsig 26-apr-2024 - osstat
-- bengsig 5-apr-2024 - cstorm, oltpxc
-- bengsig 03-dec-2020 - Add ash
-- bengsig 2017 - Creation

Expand All @@ -24,4 +26,6 @@ create or replace synonym rwlash for rwloadsim.rwlash;
create or replace synonym ashdata for rwloadsim.ashdata;
create or replace synonym oerstats for rwloadsim.oerstats;
create or replace synonym runnumber_seq for rwloadsim.runnumber_seq;

create or replace synonym cstorm for rwloadsim.cstorm;
create or replace synonym oltpxc for rwloadsim.oltpxc;
create or replace synonym osstat for rwloadsim.osstat;
5 changes: 3 additions & 2 deletions bin/ashplot
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,13 @@

# RWP*Load Simulator
#
# Copyright (c) 2021 Oracle Corporation
# Copyright (c) 2024 Oracle Corporation
# Licensed under the Universal Permissive License v 1.0
# as shown at https://oss.oracle.com/licenses/upl/
#
# call rwloadsim -u ashplot.rwl

# bengsig 9-may-2024 - Use exec
# bengsig 27-nov-2023 - Creation

rwloadsim --pretend-gen-banner='RWP*ASH Plot' -u ashplot.rwl "$@"
exec rwloadsim --pretend-gen-banner='RWP*ASH Plot' -u ashplot.rwl "$@"
5 changes: 3 additions & 2 deletions bin/awrdump
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,13 @@

# RWP*Load Simulator
#
# Copyright (c) 2021 Oracle Corporation
# Copyright (c) 2022,2024 Oracle Corporation
# Licensed under the Universal Permissive License v 1.0
# as shown at https://oss.oracle.com/licenses/upl/
#
# call rwloadsim -u awrdump.rwl

# bengsig 9-may-2024 - Use exec
# bengsig 23-nov-2022 - Creation

rwloadsim --pretend-gen-banner='RWP*AWR Dump Repository' -u awrdump.rwl "$@"
exec rwloadsim --pretend-gen-banner='RWP*AWR Dump Repository' -u awrdump.rwl "$@"
5 changes: 3 additions & 2 deletions bin/connping
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,13 @@

# RWP*Load Simulator
#
# Copyright (c) 2021 Oracle Corporation
# Copyright (c) 2022,2024 Oracle Corporation
# Licensed under the Universal Permissive License v 1.0
# as shown at https://oss.oracle.com/licenses/upl/
#
# call rwloadsim -u connping.rwl

# bengsig 9-may-2024 - Use exec
# bengsig 23-nov-2022 - Creation

rwloadsim --pretend-gen-banner='RWP*Connect/OCIPing' -u connping.rwl "$@"
exec rwloadsim --pretend-gen-banner='RWP*Connect/OCIPing' -u connping.rwl "$@"
28 changes: 28 additions & 0 deletions bin/gnuplot-check-version
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
# Copyright (c) 2024 Oracle Corporation
# Licensed under the Universal Permissive License v 1.0
# as shown at https://oss.oracle.com/licenses/upl/
#
# This file is sourced from oltpplot and mtitplot
# It cannot be called directly from the command line
#
# History
# bengsig 28-apr-2024 - Created
#

# check gnuplot version
#

gnuplotversion=$(gnuplot --version | awk '{print $2}')
gnuplotversion10=$(gnuplot --version | awk '{print 10 * $2}')

if test $gnuplotversion10 -lt 50
then
svgmouse="mouse jsdir '/usr/share/gnuplot/"$gnuplotversion"/js'"
pngtype=png
dashes="dots lw $lw"
else
svgmouse='mouse standalone'
pngtype=pngcairo
dashes="lines lw $lw dt '-'"
fi

Loading