Assistive Reality (ARX) - AR/MR | 3D modelling



  • Assistive Reality

    Assistive Reality is an Australian start-up project created by a team of forward-thinking professionals consisting of Bio and Information-Systems experts with strong experience in AI systems, user interface design, 3D modelling and a driving interest in human-augmentation technology. We believe when you embed sufficiently comprehensive AI into an Augmented Reality software solution, the resulting multiplier effect on human consistency, processing speed, memory and parallelism will improve the human quality of life, allow us to compete with pure-AI systems in the future, and potentially slow down or prevent an outright overtake of human work effort by AI. By running an Assistive Reality application on your AR/MR headset, you can recognise the incredible potential of AI-integrated Augmented Reality, getting a glimpse into a future long touted as Sci-fi, but rapidly become reality. AR/MR human assistance technologies will improve the lives of professional and home users around the world. As a group, we feel AR and MR hardware is reaching early maturity and the timing is right to launch a dedicated Augmented Reality software company now, with the goal of delivering advanced multi-platform AI-integrated AR & MR software to new devices beyond 2017. The name Assistive Reality is derived from our concept of creating applications that will use intelligent AI systems from a variety of authors, to integrate with device sensors, and cloud-computing to provide assistance to the human wearer in their professional and home life. We aim to push the boundaries of software, hardware and human integration to develop new solutions to problems currently consuming significant human time or effort. In Quarter 2 of 2018 we will release two Augmented Reality applications via each device’s store: World 1 and Profession. These applications will be built on our commercial Spectrum AR engine, natively compiled and customised for each device to obtain maximum performance. World 1 introduces the concept of an AR World Browser, allowing an always-on AR experience whether at home or in public, with seeded content and integrated AI offering configurable levels of assist. All users that hold ARX tokens gain the ability to host AR zones for multi-user interaction. Profession is intended for light professional usage, and allows the user to select a job role or task function; the AI will observe the environment through 3D positional tracking and offer visual cues and guidance specific to that task. The task database is built up by a learning algorithm that aims to continually improve its success rate. We’re currently in the start-up phase, fine-tuning alpha code on the Microsoft MR and Apple AR SDKs, while working on establishing Google and Apple compatibility in the coming months. Our team have been very active forming foundation partnerships with companies aiming to deploy enterprise-integrated AR/MR or VR solutions, and achieving commercial agreements to create dedicated applications to meet enterprise workflow and social requirements. These partnerships will be announced via our press portal (https://aronline.io/press-releases) in future.

    Each of our applications uses our in-house commercial Spectrum AR engine, which provides an API that will later be opened to the general public for development. Spectrum runs in native mode on each support AR/MR device and allows for a number of features to be shared across our applications.
    One of the important shared functions is access to the Ethereum Blockchain; to provide for a number of features such as secure storage of biometric ID hashes, data hash storage and replication, AR zone funding/rewards, for purchasing World 1 in-world games or events, and for tracking, recording and delivery of the licenses purchased by users.
    Another important shared function is the modular nature of the AI codebase selected for objects, interactions or bots within the AR space. Developers can select and customise a number of open-source AI modules when building applications on the Spectrum platform or creating AR Zones within an application like World 1.
    From a commercial standpoint, we have a fully developed business and marketing plan, and intend to approach revenue development from a number of angles. We have strong projections within the corporate AR/MR space as Spectrum provides highly advanced enterprise-integration (Office 365, AWS, Microsoft and Unix stacks), it can be readily adopted to almost any major corporation’s workflow, and its highly robust 3D object recognition capabilities enable a variety of usage cases.
    We also expect World 1 and other third-party home/public applications to be successful on each device’s native app store, since the experience they provide is so transformative for everyday life. We intend to publish our AR zone world format for consumption by other third party applications and developers in future.
    Crucial to the project’s later financial viability is our enterprise market penetration and home/public user numbers. To this end, all members of our team have strong experience building and nurturing relationships with government, defence and corporate organisations, whilst also being avid consumers of early and advanced technology themselves. We will leverage our wide-ranging contact base and a significant marketing spend across Asia-Pacific and China to gain early trials and secure demand for our AR/MR applications. To improve enterprise integration options we’ve architected features such as cloud (Office 365, AWS) and local Directory Service integration, OS policy enforcement, Blockchain secured biometrics and building-system/home-bot integration.
    Our plans for Augmentation technology are not limited to optical headsets; we are also actively researching and creating software prototypes to implement building-wide AR environments, and creating partnerships within the optics industry, with the goal of deploying code to run on contact lens or implant technology systems as and when they become available.
    Individually, we’ve previously built messaging systems, interactive meeting rooms, smart-mirrors, chat bots, AI systems and object tracking software; by leveraging these skills to ensure we are early to market on a number of a prototype products and by delivering a user experience that is of the highest quality, standardised across hardware platforms, our aim is to become the industry leader.

    What are the aims of the project?

    Mission goals

    *  Champion the integration of Artificial Intelligence software with Augmented Reality devices
    *   Enable humans to be highly competitive in complex tasks where AI has an inherent advantage
    *  Act as a catalyst for the adoption of AR/MR/VR technology in business
    *  Increase commercial awareness and adoption of the Ethereum Blockchain & smart contracts
    *  Provide an example of ICO fundraising bootstrapping a successful Tier 1 technology firm
    *  Establish relationships within the contact lens design and production industry

    Deployment goals
    *  Complete development and compatibility testing of our Spectrum Augmented Reality engine
    *  Contract to deploy 15 Spectrum application sites within 2018
    *  Ensure our Spectrum-based Profession apps reach top 10 rank/major app stores within 2019
    *  Ensure our World 1 world browser reaches top 10 rank/major app stores within 2019


    Increased adoption of AR/MR/VR has been delayed awaiting a number of incremental technological improvements; client-device internet bandwidth has required upscaling to enable effective cloud app distribution and real-time high fidelity content streaming; CPU-task offloading is more viable beyond 2017 due to the reduced latency and increased throughput of modern optic fibre, 4G/5G mobile and VDSL consumer networks; Blockchain usability has improved dramatically through Ethereum’s use of distributed applications, smart contracts and EVM processing techniques. Optics and sensor technology has taken great strides, with lightweight mounting options available. These progressions in the technology landscape are the underpinning of a revolution in the basic computer/user interface paradigm.

    timeline

    In the first 24 months we are aiming to establish the Australian division of the company Assistive Reality to facilitate research, development, deployment, demonstrations and licensing; we have also committed to a number of foundation site clients and interested parties to deliver the following clear outcomes by our March 2019 “Deploy” milestone:

    *  Perform ICO (ARX token), fund company structure, establish development contracts
    *  Demonstrate Spectrum alpha software running with sample tasks at various trade events
    *  License 5 Foundation Sites for Spectrum deployment trials in early 2018, ramping up to 15
    *  Release Spectrum beta to foundation sites, monitor and adjust onsite
    *  Release World 1 beta World Browser for Google AR, Glass, Microsoft AR/MR and Apple AR
    *  Perform World 1 closed alpha test of large-scale multiuser networking
    *  Deploy Ethereum smart contract to public main net for exchanging ARX tokens for World 1 access or Spectrum licenses
    *  Begin advanced AI-in-AR research paper regarding in-world and in-zone automation
    *  Publish a research paper discussing the future-state of human visual augmentation
    *  Scale development up to 3 full-time development team members
    *  Test private Ethereum Blockchain secure-storage smart contract functions

    We have segmented and summarised some milestones from the first 4 years of operation into clear Startup, Disrupt, Deploy and Scale phases, as shown below:

    Our initial operational emphasis is twofold; (1) To develop and deploy our Spectrum AR engine to major corporations around the world, either standalone or in combination with comprehensive solutions including room-integrated hardware (spatial sensors), audio systems, open AI bots and backend Ethereum Blockchain services, and (2) To develop and distribute World 1; the first AR World Browser application to be available simultaneously on all major platforms to allow home users to explore the real world through a dynamic visual interface, with a range of advanced functionality. It is also expected World 1 will allow the user to discover applications, live content and participate in AR World zone activities made available through social media or web pages/stores.

    Why is Ethereum integration important?

    Ethereum is a leading cryptocurrency in 2017 and has many advanced features including Turing-complete smart contract scripting and sandboxed code execution. Ethereum’s EVM programmability has contributed to the rise of many distributed applications and offers unique integration options for AR/MR applications. Building our software with native support for Ethereum technology provides the following benefits for our users:

    * Private or Public Blockchain-secured Biometrics for each user provide security, audit trail, and data survivability with integrity beyond a typical private database
    *  Swarm technology is leveraged for roaming user data and some profile information
    *  Smart contracts are executed using distributed computing (nodes) allowing a degree of processing-offload for miniaturised devices
    *  Ethereum configurations are already available within major cloud provider services, giving immediate, well-understood scaling when storing data for enterprise client solutions
    *  Ethereum has a strong development roadmap and community, with good leadership, which has led to widespread trust and adoption across a range of platforms, by a variety of internationally-respected companies; integrating with Ethereum allows us to work with a proven community of professionals with established toolsets and practices, increasing consistency and standardisation

    Users of our World 1 world browser will utilise Ethereum integration to interact with paid content in the same way a credit card enables in-app purchases for a traditional Store. We are currently experimenting with coding techniques to use the Ethereum Blockchain itself to track the state of individual AR Zones with various lazy-write cache mechanisms. Direct interaction with Ethereum smart contracts is high on our development priority list for World 1 and Spectrum, with complete Ethereum Blockchain integration (inbuilt wallet for each headset user profile, gesture and basic biometric private key support) coming before the March 2019 release milestone. The array of possible usage cases for Blockchain-integrated AR applications is limited only by imagination; one example is a Doctor entering a hospital room to examine a patient in a modern AR-equipped hospital. As the Doctor enters the patient is automatically identified by sensors on the Doctor’s optical device and a patient retrieval smart contract is called to obtain the details of their current stay. The smart contract examines the list of approved requestors for this patient ID on a Blockchain to locate the key provided by the Doctor’s device to allow the retrieval of medical history. The current chart/info for the patient may be sourced from an existing Enterprise health care management product; seamlessly retrieved in the background and presented to the doctor as an eyes-up information stream.

    * ARX tokens issued in our ICO can be exchanged using the redemption smart contract for World 1 and Profession early access
    *  ARX tokens and ETH can be used to interact with paid content in all Assistive Reality consumer-facing applications, including AR zones that contain premium content
    *  Ethereum’s developer community will be directly leveraged to hire coders and testers for smart contracts and Blockchain integration when building World Zones and assistive AI Bots
    *  As an early developer and integrator, Assistive Reality aims to gain significant market share within Government, Defence and Corporate organisations, exposing them to Ethereum technology potentially for the first time, expanding the reach of Ethereum in general

    What is our vision for professional users?

    We envisage professional usage of Augmented Reality to occur at a large scale; car production factories, construction projects, law enforcement, education and health care are all examples of sectors that can benefit enormously from intelligent augmentation software solutions.
    For professional users, we provide two options during 2018/2019;
    1. Engage with us to plan a custom-built application/suite based on our bespoke Spectrum platform with onsite hardware integration, AR/MR zones, room-scale VR facilities, Ethereum Blockchain integration. This option is recommended for larger companies who have significant facilities or high staff numbers. The following diagram shows the engagement process for a partner company who desires a customised commercial-grade Augmented Reality/Mixed Reality solution:


    2. Purchase the Profession application from the app store on your device; this is our prebuilt user-customisable application. Profession is recommended for smaller companies or other users that may be performing a work activity and is available with alternative UIs and a selectable list of professions.
    Profession features include:
    *  Switchable user interface (for different job roles, or preferences)
    *  Professions to select will be added regularly
    *  Surface-to-screen projection
    *  AI-bot or Virtual Assistant
    *  Fine-tuned UI/UX for each profession type
    *  Guided Action with prompting
    *  Real-time Communications
    *  App integration
    *  Blockchain Recording and Archiving
    *  Room and Dimensional-space scaling


    Example of features for different professions Innovative software implementation of these features can revolutionise day to day activities in a vast number of companies. It is important to note the Profession application and its interfaces/plug-ins are running on a consumer version of our Spectrum engine. Spectrum is a bespoke Augmented and Mixed reality application engine developed from the ground-up on each major platform (Google AR, Apple AR, and Microsoft AR/MR) to provide significant professional-focused advantages over traditional SDK developed applications. The beta release of Profession is targeting the following high level AR feature support on Google, Apple and Microsoft devices, with some variance based on final specifications and individual model capabilities:

    Throughout 2018 Assistive Reality will be performing onsite deployments of Spectrum-powered custom applications with Government, Defence and Corporate clients in Australia to generate demand and secure licensing contracts for 2019. Each implementation will utilise a Spectrum-based AR/MR/VR solution using the 2018 beta interface, AR zones, backend Ethereum Blockchain storage and include onsite training. Spectrum-based applications feature a consistent look, feel and set of user input conventions to ensure there is minimal retraining requirements when staff move between roles within a company. Deployment to our foundation clients will provide us with real-world deployment feedback, engineering and development partnerships, and allow us to fine-tune user input and fatigue-management techniques.

    What is our vision for home users?

    For home users we are releasing our flagship multiplatform application for AR/MR devices called World 1. World 1 is the first multiplatform use-anywhere AR/MR World browser. Our vision of the world browser is that it is a passive user interface for the Augmented Reality wearer, to provide un-obtrusive assistance for anything and everything; detecting objects in the real world and using cloud-CPU processing to match object motion with real-world task assistance profiles, presenting content designed to assist the wearer, such as the provision of passive metrics like distance-to, depth, colour values, or even real-time facial emotion analysis. A real-time HUD for the real world. There are many possibilities for the future usage cases of World 1 such as dedicated task zones based on physical location, networked task coordination and gaming for groups of people, visualisation of building or landscaping plans, 3-dimensional virtual object sharing, etc. Once Augmented Reality devices are sufficiently unobtrusive and socially acceptable, this technology is expected to be significantly transformative.
    High on our development priority list is ensuring World 1 is fully compliant with all upcoming standards for accessing content in AR and VR Worlds. After installing the World 1 application from the device’s native app store, a user can activate their AR/MR device and utilise the dynamic nature of the browser interface and real-time cloud-based sensor analytics to navigate the real world while remaining open to augmented content. For Augmented or Mixed Reality devices, it’s easy to imagine a world where you can walk around your home using voice or gesture commands to assign a virtual screen to a blank wall of your kitchen, showing a HTML page with a recipe while you cook. A recipe application executed by World 1 can use the device’s native sensors to observe the ingredients as the wearer makes the meal, and use Guided Action prompting to guide the wearer through the process. Outside the home, walking to a nearby bus station grants the wearer the benefits of live 3-dimensional object recognition highlighting points of interest along the way; the bus station distance and time remaining to walk, with a transparent-hover to launch the native Android or iOS bus timetable application in-place, giving non-intrusive information to the wearer with low data and processing requirements. Individual apps can be rendered to floating bubbles or other virtual screens. Any surface in the real world of sufficient dimensions and reflective properties can be marked as a desktop workspace or virtual screen to which a variety of cloud or local sources can be connected. Assistive Reality will work with the Ethereum community to encourage the development of Blockchain-based applications for the Augmented/Mixed and Virtual Reality modes of World 1.

    What technology does Assistive Reality use?

    Our Spectrum engine powers all Assistive Reality applications and is written in a number of core stacks simultaneously to ensure we have a common API available for use by higher level components wherever possible. We specifically utilise a combination of native device SDKs (ARKit, ARCore), OS API (for Android), C#/.Net, and 3D Engine scripting within Unity3D and Unreal Engine. For certain implementation types we have found Augment and Vuforia to offer elements we can integrate with Spectrum for a deeper experience. We support platforms across the industry such as SteamVR, Apple Store and Google Play for deploying our applications. In the future we hope to publish our Spectrum engine API and allow developers to create Enterprise AR applications for licensing by our corporate and government clients.


    We will initially provide support for the following hardware devices:

    AR/MR

    -  Microsoft HoloLens and other MR SDK devices
    - Apple AR-kit based devices
     - Google ARCore
    -  Google Tango and/or Glass native

    VR

    -  HTC Vive
    -  Oculus Rift
    -  GearVR

    Pre-sale and ICO instructions

    The following schedule will be followed for Assistive Reality’s ARX token Pre-sale and subsequent Initial Coin Offering (ICO). The price of ARX tokens will be on a sliding scale based on how early they are purchased:

    A number of wallets support ERC20 tokens (with more being added monthly) and therefore support our ARX token, such as:
    MyEtherWallet (no download needed) https://www.myetherwallet.com/ MetaMask (Firefox and Chrome browser add-on) https://metamask.io/ Mist (Desktop) https://github.com/ethereum/mi... Parity (Desktop) https://ethcore.io/parity.html imToken (iPhone) https://itunes.apple.com/us/ap... imToken (Android) https://token.im/
    Contact us at [email protected] for more information about a specific wallet or query. It is important to consider that potential network congestion can cause temporarily higher fee requirements for the transactions. Our Pre-sale and ICO contracts are fully tested with Mist which successfully predicts the correct gas values, however we also include some comment around the gas values you may need to provide for successful operation of our Pre-sale and ICO contracts.
    The screenshots and instructions below will guide you through a few methods of participating in the Pre-sale, including configuring your Mist browser to ‘watch’ the Assistive Reality ARX token, and to send an Ether donation to the Pre-sale or ICO contract. The ARX tokens should be retained in your personal wallet until such time as you redeem them using our redemption smart contracts for aronline.io services or apps, or trade them on digital currency exchanges.

    Participating in the Pre-sale:

    The Pre-sale contract parameters, address and JSON interface definition are below:


    Price configuration:
    Limited Pre-sale cap: 1,000 ETH
    29 Sep 19:00 GMT: Pre-sale begins! 

    29-30 Sep: 1 ETH = 8,000 ARX (1st day bonus) 29/09 @ 19:00 to 30/09 @ 19:00 = +24 hours (s+3600 blocks)

    30-02 Oct: 1 ETH = 7,250 ARX (2nd & 3rd day bonus) 30/09 @ 19:01 to 02/09 @ 19:00 = +48 hours (s+10800 blocks)

    02-04 Oct: 1 ETH = 6,750 ARX (4th & 5th day bonus) 02/09 @ 19:01 to 04/09 @ 19:00 = +48 hours (s+18000 blocks)

    05-06 Oct: 1 ETH = 6,250 ARX (6th & 7th day bonus) 04/09 @ 19:01 to 06/09 @ 19:00 = +48 hours (total = +7 days) (s+25200 blocks) 

    06 Oct 19:00 GMT: Pre-sale ends!


    To participate in our ARX token Pre-sale after the Start Block 4323576, which should occur on the Ethereum main net Blockchain around Friday the 29th of September @ 7:00PM GMT (though when the block occurs can vary slightly) you have a few options, such as:
    1. Use any of the wallets below to send ETH to the Pre-sale contract address 0x0
    You will receive your tokens in return immediately. Mist recommends around 76,000 gas for the transaction on mainnet and has no problem with the transaction by default however during the Pre-sale period fee contention can occur; if you experience issues, try a higher fee.
    MyEtherWallet (no download needed) https://www.myetherwallet.com/ MetaMask (Firefox and Chrome browser add-on) https://metamask.io/ Mist (Desktop) https://github.com/ethereum/mi... Parity (Desktop) https://ethcore.io/parity.html imToken (iPhone) https://itunes.apple.com/us/ap... imToken (Android) https://token.im/

    2. Or, Use the Mist browser on a Synchronised Node to send ETH to the Pre-sale contract address. You will receive your tokens immediately in a return transaction. You should also select ‘Contracts’, ‘Watch token’, then copy/paste the Pre-sale contract address into the address field, and click OK once the browser fills in the remainder of the form with the ARX token information. This will enable you to see your tokens. See later in this section for screenshots.
    0x0
    3. Or, Use the Mist browser (or alternative) to execute the BuyTokens function in the Pre-sale contract, which looks like this and will send you tokens in return for your ETH. This function requires a very small amount of additional gas compared to sending ETH to the Pre-sale address directly. Mist recommends around 76,000 by default though this can vary.

    To do this, for example within the Mist browser, you would need to select ‘Contracts’ then ‘Watch contract’, then Copy/Paste the ICO contract address (0x0 – the ICO contract issued this token initially when deployed) into the address field:
    a. Click contracts, scroll down to Custom Contracts, and click Watch Contract:

    b. Paste in the contract address 0x0
    c. Enter a name such as ARX token Pre-sale
    d. Paste in the contents of the JSON interface file, into the JSON field, contents available on GitHub here, or via TBC

    e. Click OK to proceed with watching the contract


    f. Now that you have added the contract to watch, you may also wish to watch the token so you can see when they are transferred to you. In mist, this is achieve by scrolling down the ‘Contracts’ page until you see ‘Custom Tokens’ then clicking ‘Watch Token’

    g. In the token watch entry form, paste in the token ICO contract address (0x0 – the ICO contract issued this token initially when deployed). The remainder of the form will auto-fill if you have entered the address correctly. Confirm you can see the ARX token details such as below, and click OK.

    h. Now that you have both the token and contract being watched, you are free to use the functions provided by the Pre-sale contract, and will see the ARX tokens when they arrive into your wallet. Simply click on the Contract ‘ARX Pre-sale’ in the ‘Contracts’ section of Mist, and scroll down to see the functions, not all of which are available to you:

    i. Enter the amount you wish to purchase, then click execute, authorise the transfer and you’ll see the exchange ETH/ARX occur and receive your ARX immediately (screenshots below are from testnet contract since the Pre-sale disallows purchases until block 4402956)



    As a general recommendation we have observed that the gas price for interacting with the Pre-sale contract is always fine at the default in Mist (and was between 50,000 and 80,000 for most functions), therefore a synchronised Mist wallet is recommended. However any of the common wallets that support (in full) ERC20 tokens can be used. If any fee contention or gas issues are experienced increase your paid fees until your transaction is successfully mined; though we have taken some effort to attempt to minimise the gas cost of the ARX Pre-sale contract.

    You can view information about the Pre-sale by watching the contract in Mist, then selecting it under Contracts and scrolling down from the header. Many fields will update live during the Pre-sale, and a few allow interaction during the sale (for example, the ‘approve’ function and the ‘balance of’ fields)

    Participating in the ICO:

    The ICO contract parameters, address and JSON interface definition are below:


    To participate in the ARX token ICO after Start Block 4323576, which should occur on the Ethereum main net Blockchain around Friday the 29th of September @ 7:00PM GMT (though when the block occurs can vary slightly) you have a few options, such as:
    4. Use any of the wallets below to send ETH to the ICO contract address 0x0
    You will receive your tokens in return immediately. Mist recommends around 76,000 gas for the transaction on mainnet and has no problem with the transaction by default however during the ICO period fee contention can occur; if you experience issues, try a higher fee.
    MyEtherWallet (no download needed) https://www.myetherwallet.com/ MetaMask (Firefox and Chrome browser add-on) https://metamask.io/ Mist (Desktop) https://github.com/ethereum/mi... Parity (Desktop) https://ethcore.io/parity.html imToken (iPhone) https://itunes.apple.com/us/ap... imToken (Android) https://token.im/

    5. Or, Use the Mist browser on a Synchronised Node to send ETH to the ICO contract address. You will receive your tokens immediately in a return transaction. You should also select ‘Contracts’, ‘Watch token’, then copy/paste the ICO contract address into the address field, and click OK once the browser fills in the remainder of the form with the ARX token information. This will enable you to see your tokens. See later in this section for screenshots.
    0x0
    6. Or, Use the Mist browser (or alternative) to execute the BuyTokens function in the ICO contract, which looks like this and will send you tokens in return for your ETH. This function requires a very small amount of additional gas compared to sending ETH to the ICO address directly. Mist recommends around 76,000 by default though this can vary.












    Team:https://aronline.io/who-is-ass...


    Website:https://aronline.io/



Looks like your connection to Cryptocentral was lost, please wait while we try to reconnect.