Home › Technical articles

Đọc bằng tiếng Việt

SCADA server redundancy: FactoryTalk View SE, AVEVA System Platform, Ignition and switchover tests

TDL Industrial Automation · Last updated:

A redundant SCADA server pair covers only the server layer. Each failure mapped to the layer that covers it, how FactoryTalk View SE, AVEVA System Platform and Ignition switch over according to their vendors, what virtualisation HA and Fault Tolerance do, historian buffering, network and controllers, what operators see, and a switchover test list for FAT and SAT.

SCADA server redundancy means a second server that can take over the work of the first one: the displays, the data connections to the controllers, the alarms and the history. FactoryTalk View SE, AVEVA System Platform and Ignition each do this with a primary and a secondary (or backup) running on separate computers, and each vendor documents which parts move at a switchover and which do not. Redundant servers protect only the server layer, so the network, the controllers, the virtualisation platform and the historian each need their own decision.

What can fail, and which layer covers it

The table maps each kind of failure to the layer that the vendor documents describe as covering it.

What fails Layer that covers it What the vendor documents say
Server hardware A redundant server pair on a second computer, or the hypervisor Rockwell and AVEVA require the secondary on another computer; Ignition pairs two separate gateways. vSphere HA restarts virtual machines on other hosts; Fault Tolerance keeps a secondary copy running on another host.
Windows or the SCADA service on the active computer The redundant server pair AVEVA: on a hardware or software failure of the active computer, the standby AppEngine becomes active. vSphere can reboot a virtual machine whose heartbeat stops.
Network between servers and clients Network redundancy (DLR, PRP) PlantPAx lists PRP and DLR topologies; a simplex star has no redundancy.
Network between the redundant servers A dedicated link AVEVA requires a separate network card and a dedicated connection for the redundancy message channel.
Controller Controller redundancy In PlantPAx, ControlLogix controller redundancy requires the 1756-RM3 redundancy module.
Historian archive or collector Buffering and redundant collectors FactoryTalk Historian SE supports redundant interfaces with buffering on both, and server collectives; Ignition caches history through Store and Forward while the database is unavailable.
The redundancy layers of a SCADA systemFive layers from the top: operator clients, SCADA servers, virtualisation platform, network and controllers. Each layer has its own redundancy option and covers only the failures of that layer.The redundancy layers of a SCADA systemOPTIONSPROTECTS AGAINSTClientsseveral operator stations; eachclient follows the active serverloss of one operator stationServersprimary/secondary pair: HMI, data andalarm servers (FactoryTalk View SE),AppEngines (AVEVA), master/backupgateways (Ignition)failure of the server hardware,Windows or the SCADA serviceon the active computerPlatformvSphere HA restarts thevirtual machine on another host;Fault Tolerance keeps anidentical copy on another hosthost failure; with HA,the virtual machine andits application restartNetworkDLR ring; PRP withtwo parallel LANs; redundant power,separate cable pathsDLR: one break in the ring; PRP:a fault in one of the two LANsControllersredundant ControlLogix chassispair with the 1756-RM3 modulea fault in the primary controllerBased on FactoryTalk View SE 16.00 and FactoryTalk Services Platform 6.60 help,AVEVA Application Server and Ignition 8.3 documentation,VMware vSphere Availability and Rockwell PROCES-SG001X. Figure: drawn by TDL.
Figure 1: The redundancy layers of a SCADA system. On a phone, swipe sideways to see the whole figure.

FactoryTalk View SE: redundant server pairs

In FactoryTalk View SE, HMI server redundancy is available only in network distributed applications. One computer hosts the primary HMI server and another the secondary; when the primary cannot serve clients, the clients move to the secondary and keep working. The two computers must have synchronised clocks, and the HMI server must be set to load and run its components when Windows starts.

The FactoryTalk Services Platform help lists the servers that can be made redundant: HMI servers, and data servers such as FactoryTalk Linx, OPC DA, Tag Alarm and Event, FactoryTalk Batch and OPC UA servers. The secondary cannot run on the same computer as the primary, the two must be configured identically, and once a pair is configured every client in the application uses it with no extra setup.

Two settings decide what happens after a failure:

  • Switchover option. With FavorCurrent, the default for new HMI servers, the system stays on the secondary after the primary returns until a user switches over or the active server fails. With FavorPrimary, the primary takes over again as soon as it is ready.
  • Keeping the pair in step. FactoryTalk View Studio can save online edits to both active and standby HMI servers and synchronise HMI memory tag values between them; the Redundancy tab also has a command to replicate the active server's project to the standby.

The FactoryTalk Directory is a separate question. If the Network Directory server is unavailable, each computer keeps a local copy of the Directory information: running clients can still read and write values, acknowledge alarms and open displays, but nobody can change the application's structure, such as adding or editing an area, a data server or an HMI server, until it returns. When the Directory and Activation server run on a PlantPAx server (PASS) in a redundant configuration, they are on the primary PASS only, and for distributed architectures the PlantPAx selection guide recommends a standalone Directory server. Rockwell's help also gives an example where the pair switched back to the primary against the "stay on secondary" setting: the primary hosted the Network Directory, a hidden FactoryTalk service counted as an extra client, and the health monitoring service picked the server with more clients.

AVEVA System Platform: redundant AppEngines and data sources

AVEVA Application Server provides redundancy in two places. AppEngine redundancy uses a primary AppEngine and a backup that the system creates when redundancy is enabled, hosted by two WinPlatforms on different computers running the same operating system. Data acquisition redundancy uses two DIObjects as data sources and a RedundantDIObject that monitors them and switches between them.

At run time the configured primary and backup become the active and standby engines, and either one can be active. They monitor each other over the redundancy message channel (RMC), which also carries message handling and data synchronisation. Each computer needs at least two network cards: one for the supervisory network and one for a dedicated Ethernet link between the pair. The store-and-forward directory settings must be the same on both WinPlatforms.

With warm redundancy, the default for new pairs, the standby engine starts and initialises alongside the active one and DI objects subscribe to both, so failover is much faster than in the legacy mode, where the standby starts only at failover. The standby takes over after the Engine Failure Timeout, 30 seconds by default, which AVEVA says may need tuning for the application. A failed active engine restarts and becomes the standby.

For trends, InTouch HMI 2026 supports a primary and a partner AVEVA Historian; when the primary fails, InTouch reads from the partner with no change to trends or scripts.

Ignition: master and backup gateways

Ignition redundancy is a two-node system: a master gateway that holds the configuration and a backup that receives it. Runtime state, such as current alarm states, is also synchronised so that the backup can take over with the master's state. The backup connects to the master over the Gateway Network, so the port must be open through any firewall between them.

  • Standby activity level. A cold backup connects to OPC servers without subscribing to tag values, which avoids device load but fails over more slowly; a warm backup runs like the active node except that it does not log data or write to devices.
  • Recovery mode. In Automatic mode the master takes control again when it returns; in Manual mode the backup stays active until it fails or a user requests a switchover.
  • History mode. Full logs history from the backup directly and can create duplicates, because the backup cannot tell whether the master is down or only unreachable; Partial caches history and forwards only what was collected while the master was actually down.

The database is outside the redundant pair. Ignition's documentation describes failover datasource connections and notes that all history goes through Store and Forward, so it is cached while the database is unavailable. The backup gateway needs its own licence with the same modules as the master; otherwise data could be lost during a failover.

A primary and secondary server pair at switchoverClients and the historian reach the server pair over the supervisory network; the pair reaches the controllers over the control network. Solid lines are the paths in use, dashed lines the paths the secondary takes over at switchover, dotted lines the synchronisation between the pair.A primary and secondary server pair at switchoverOperator clientsdisplays, alarms, writes;follow the active serverHistorianfed by the active server;buffers when its link is downSupervisory networkPrimary serverHMI, data, alarm servers · activeSecondary serversame configuration · standbyControl networkControllersthe active server reads and writes tagsAt switchover the standby becomes active and the clients and historian follow it; thefailed server returns as standby or takes over again, depending on the switchback setting.Path in usePath the secondary takes over at switchoverSync between the pair: configuration, alarm state, online editsBased on FactoryTalk View SE 16.00 help, AVEVA Application Serverand Ignition 8.3 documentation. Figure: drawn by TDL.
Figure 2: A primary and secondary server pair at switchover. On a phone, swipe sideways to see the whole figure.

Virtualisation: high availability and fault tolerance

When the SCADA servers run as virtual machines (PlantPAx supports VMware and Nutanix AHV), the hypervisor adds its own availability options. VMware's vSphere Availability guide describes two levels:

  • vSphere HA restarts the virtual machines of a failed host on other hosts in the cluster. VM Monitoring can also reboot a virtual machine when its VMware Tools heartbeats stop, and Application Monitoring can restart it when an application stops sending heartbeats, which needs VMware's SDK or an application that supports it.
  • Fault Tolerance keeps a secondary virtual machine on another host in the same state as the primary at every instruction. If either host fails, the other continues with no data loss and network connections kept, and a new secondary is created.

With HA the server boots again on another host, so the SCADA application restarts. VMware describes the Fault Tolerance failover as the response to a host failure; for a virtual machine or an application that stops responding, vSphere HA offers VM Monitoring and Application Monitoring, which restart the virtual machine. The two layers can be combined with application redundancy: the PlantPAx guide sizes a virtualised system so that a three-server system with VMware HA or Fault Tolerance can still run on two servers after a failure.

Historian: buffering and redundant collectors

A switchover should not leave a gap in history. In FactoryTalk Historian SE, interface redundancy is usually paired with FactoryTalk Linx data server redundancy; the two interface nodes coordinate through a failover control file on a network share, buffering is configured on both through the PI Buffer Subsystem, and the buffer should sit on a local drive other than C. The PlantPAx guide adds that a redundant historian must be licensed for the same number of tags. Buffering, buffer limits and the Ignition and AVEVA equivalents are covered in what is a process historian.

Network and controllers

Server redundancy does not help if the only switch or the only controller fails. The PlantPAx selection guide recommends redundant power sources and separate physical cable paths for no single point of failure. PRP doubles the cabling and components and has zero recovery time inside the PRP zone; DLR recovers from a single break in the ring in 3 ms or less. PlantPAx requires the 1756-RM3 redundancy module for all ControlLogix redundancy configurations. See DLR or PRP and the ControlLogix redundancy pre-FAT checklist.

TDL project pages show these layers on Rockwell systems: at Ba Ria Gas Distribution Station the PLC-5 / RSView32 system moved to redundant ControlLogix with FactoryTalk View SE server and clients and EtherNet/IP DLR remote I/O, and at BSR four steam turbine generator systems moved from ControlNet to a redundant EtherNet/IP network and from RSView32 to FactoryTalk View SE.

What operators see during a switchover

The vendor documents describe the switchover from the client's side as follows:

  • FactoryTalk View SE: clients move to the secondary and keep functioning. Rockwell describes alarm and event server redundancy, Tag Alarm and Event servers included, as automatic and transparent to clients: operators take no action and do not restart the client software. The FactoryTalk System Status Portal shows each server as Active, Standby, Failed, Transitioning and so on.
  • Ignition: Vision clients reconnect to the other node and tell the user they were moved. Perspective sessions try their original gateway first and, if the backup becomes active first, open the same project and page on the backup.
  • AVEVA System Platform: the standby engine becomes active after the failure timeout. AVEVA notes that scripts which read attributes right after a failover may see them still initialising, so such scripts need retry logic.

None of these documents gives a switchover time for a whole system. Measure it at FAT on the real application and record it.

Switchover tests for FAT and SAT

Switchover test sequence for FAT and SATEight test steps from the top: baseline, manual switchover, fail the active server, return it, stop the FactoryTalk Directory, break the historian path, fail a virtualisation host, restart a redundant node; record the result of each step.Switchover test sequence for FAT and SAT1Baselinecorrect Active and Standby states, clocks in sync, last online edits on both servers2Manual switchoverswap roles on purpose; clients keep working3Fail the active serverpower it off, then unplug its network; check displays, writes, alarms4Return the failed serverswitchback behaves as configured; look for hidden clients5Stop the FactoryTalk Directoryrunning clients keep working; areas and servers cannot be added or edited6Break the historian pathcollection continues; buffered data arrives7Fail a virtualisation hostthe virtual machine restarts (HA) or continues (Fault Tolerance)8Restart a redundant nodecheck network connections after the restart (AVEVA RMC)Record the states and the times you measure on site; thevendor documents give no switchover time for a whole system.Based on FactoryTalk View SE 16.00 and FactoryTalk Services Platform 6.60 help,Rockwell HSELD-RM001B, AVEVA Application Server andIgnition 8.3 documentation and VMware vSphere Availability. Figure: drawn by TDL.
Figure 3: Switchover test sequence for FAT and SAT. On a phone, swipe sideways to see the whole figure.
  1. Baseline. Both servers show the expected Active and Standby states, clocks are synchronised, and the last online edits are on both servers.
  2. Manual switchover. Swap roles on purpose: the Switchover command from a FactoryTalk View SE client, Ignition's Request Failover, or a forced failover in System Platform. In FactoryTalk View SE the command is ignored when the pair is set to switch back to the primary.
  3. Fail the active server. Power it off, then repeat by unplugging its supervisory network. Check displays, writes to the controller, alarm states and acknowledgements on every client type.
  4. Return the failed server. Confirm that the switchback setting behaves as configured, and look for hidden clients such as a Directory service on the primary.
  5. Stop the FactoryTalk Directory server (Rockwell systems). Running clients should keep working; adding or editing areas and servers waits until it returns.
  6. Break the historian path. Restart the active collector (the primary interface) several times, as Rockwell's Historian SE guide suggests, and check that data collection continues. Then disconnect the historian archive for a while, reconnect it and check that the buffered data arrives.
  7. Fail a virtualisation host. Confirm whether the SCADA virtual machine restarts (HA) or continues (Fault Tolerance), and how the application pair reacts.
  8. Restart a redundant node. For System Platform, AVEVA warns that restarting with the primary network disconnected can bind it to the RMC address; check network connections after every restart.

If firewalls sit between the servers, check which ports a FactoryTalk system needs; if a client cannot reach the servers after a switchover, start with FactoryTalk View SE client cannot connect. TDL's work on these platforms is described on the SCADA and historian and Rockwell upgrade pages.

Frequently asked questions

Does FactoryTalk View SE redundancy work in a network station application?

Rockwell's help states that HMI server redundancy is available only in network distributed applications. The secondary HMI server runs on a second computer with synchronised clocks.

What happens to FactoryTalk View SE clients if the FactoryTalk Directory server goes down?

Running clients keep working from a local copy of the Directory information: they can read and write values, acknowledge alarms and open displays. The application's structure, such as areas, data servers and HMI servers, cannot be changed until the Directory server returns.

Is VMware HA enough instead of a redundant SCADA server?

VMware HA restarts the virtual machine on another host, so the SCADA application starts again. Fault Tolerance keeps an identical secondary virtual machine running on another host, and VMware describes its failover as the response to a host failure. Application-level redundancy runs a second, separate SCADA server, and the two can be combined.

Does the Ignition backup gateway need its own licence?

Yes. Inductive Automation's documentation says the backup node needs a licence with the same modules as the master; otherwise data could be lost during a failover.

Why does an AVEVA redundant AppEngine pair need two network cards?

AVEVA requires one card for the supervisory network and one for a dedicated link that carries the redundancy message channel, which handles monitoring, message handling and data synchronisation between the pair.

Sources

Read 2 November 2026. This article paraphrases the sources and does not quote them; read the original documents before designing or working on a system.

Related services:
SCADA & historian Rockwell Automation upgrades