Instead of bonding you can use Oracle cluster interconnect HAIP for using multiple ethernets.
And here is how its done 🙂
At the begining I have one interconnect – eth1:
SQL> select * from GV$CLUSTER_INTERCONNECTS;
INST_ID NAME IP_ADDRESS IS_ SOURCE
---------- --------------- ---------------- --- -------------------------------
1 eth1:1 169.254.160.183 NO
2 eth1:1 169.254.83.127 NO
7 LINESTEXT / UTF-8
To add another one (eth3), I will use an oifcfg tool:
[root@rico ~]# ifconfig eth3 | grep "addr"
eth3 Link encap:Ethernet HWaddr 08:00:27:C8:72:97
inet addr:10.1.0.1 Bcast:10.1.0.255 Mask:255.255.255.0
inet6 addr: fe80::a00:27ff:fec8:7297/64 Scope:Link
[root@rico ~]# ssh kowalsky "ifconfig eth3 | grep addr"
root@kowalsky's password:
eth3 Link encap:Ethernet HWaddr 08:00:27:69:39:73
inet addr:10.1.0.2 Bcast:10.1.0.255 Mask:255.255.255.0
inet6 addr: fe80::a00:27ff:fe69:3973/64 Scope:Link
[root@rico ~]# oifcfg setif -global eth3/10.1.0.0:cluster_interconnect
[root@rico ~]# oifcfg getif
eth0 192.168.56.0 global public
eth1 10.0.0.0 global cluster_interconnect
eth3 10.1.0.0 global cluster_interconnect
16 LINESTEXT / UTF-8
Now the restart of the CRS on all nodes is required for changes to be effective.
SQL> select * from GV$CLUSTER_INTERCONNECTS;
INST_ID NAME IP_ADDRESS IS_ SOURCE
---------- --------------- ---------------- --- -------------------------------
1 eth1:1 169.254.74.205 NO
1 eth3:1 169.254.228.254 NO
2 eth1:1 169.254.127.172 NO
2 eth3:1 169.254.244.158 NO
9 LINESTEXT / UTF-8