Data storage and management

Listen

On this page

Platforms and systems for managing data

You will need to select a platform(s) to manage data from smart devices.

To do this:

consider adopting a framework approach. This brings together several best-of-breed solutions, rather than procuring or developing a single end-to-end solution
ensure your preferred data platform(s) support sharing with other government data platforms
take an agile approach to the data management framework. This way you can flexibly meet new needs and overcome new challenges when or if they arise.

Data storage

There are 2 ways to store data from smart devices: on-premise and cloud-based solutions.

On-premise solutions

On-premise solutions require data storage software to be installed onsite. This generally provides greater protections for the data than cloud-based solutions.

However, on-premise solutions can cost a lot more than cloud-based solutions and need:

in-house server hardware
software licenses
integration capabilities
in-house employees to provide support and management.

Cloud-based solutions

Cloud-based solutions are completely hosted by a third-party provider. They are a subscription-based service that can accommodate a wide range of data storage needs. There is no capital outlay needed for these solutions.

NSW Government Cloud Policy

The NSW Government Cloud Policy requires agencies to make use of public cloud services as the preferred approach.

Data visualisation

Data visualisation can help communicate data to support insights and decision making.

Lots of visualisation tools are available. You should consider:

choosing a visualisation tool to match the type of data being analysed and the decisions you are trying to inform
understanding end users and their needs
designing a prototype of any dashboards and tools and testing them.

In smart places:

Different stakeholders might need separate visualisations. Leaders in an organisation, operators and the wider community will likely need to know different things, based on the decisions they are making.
Consider the layout of data and how this can help with insight generation. Data should be displayed so it is aligned horizontally and vertically and on scales that make sense. Make sure data isn't aligned in ways that suggest irrelevant correlations and comparisons.
Consolidate the data being visualised whenever possible. For example, if 2 different datasets can be represented on the same axis and still have the desired effect, do so.
Keep things engaging but to the point. Avoid over-the-top 3D effects and colours. These will make the visualisation more difficult to understand.

Related resources

Data for Places – A practitioner's guide helps practitioners or place owners understand the application of data in the management and monitoring of place.
The NSW Spatial Digital Twin provides a platform for data sharing and has a visualisation tool.
The NSW Data Analytics Centre provides data support services and collaborates with government agencies to tackle complex problems.
The Data Governance Toolkit helps realise the full potential of data opportunities. It guides a consistent approach to data governance, supporting best practice.
Use Data.NSW's helpful Data Sharing Checklist when sharing data or responding to data requests.
Explore the NSW Design System, a toolkit to help digital product teams create good customer experiences quickly. View the section on Data visualisation.