AEM With MongoMK - Options

We can have 2 types of MongoMK configurations for AEM Oak Clusters.

1) Failover for High Availability in a Single Datacenter

Here a primary MongoDB will be used for Read/Write. So the multiple Oak instances accessing a MongoDB replica set within a single data center.
This setup helps for high availability and redundancy in the event of a hardware or network failure

Major advantages are,

• Scalability
• High availability
• redundancy
• automated failover of data layer

One of the disadvantage of this setup is, there are some performance issues when compared with TarMK.

2) Failover Across Multiple Datacenters

Here multiple Data Centers are involved. Primary MongoDB will be replicated to secondary systems. So multiple Oak instances accessing a MongoDB replica set across multiple data centers. In this configuration, MongoDB replication provides the same high availability and redundancy as comapared to previous configuration but it also includes the ability to handle a data center outage.

Major advantages are,

• Scalability
• High availability
• Redundancy
• Automated failover of data layer

Final notes:
Always remember this. Adobe highly recommends TarMK as the default persistence technology for both the AEM Author and Publish instances, except in the use cases outlined here.

Foot notes:
What is MongoDB Arbiter. Why we need an Arbiter?

In software the CAP theorem says, "If there are equal number of servers on either side of the partition, the database cannot maintain CAP (Consistency, Availability, and Partition tolerance). An Arbiter is specifically designed to create an -imbalance- or majority on one side so that a primary can be elected in this case."

As per MongoDB site(https://docs.mongodb.com/v3.4/tutorial/add-replica-set-arbiter/) "Arbiters are mongod instances that are part of a replica set but do not hold data. Arbiters participate in elections in order to break ties. If a replica set has an even number of members, add an arbiter. Arbiters have minimal resource requirements and do not require dedicated hardware. You can deploy an arbiter on an application server or a monitoring host."

If you get an even number of nodes on both sides, MongoDB will not elect a primary and your set will not accept writes.

Videos on AEM & Persistence
AEM Persistence TarMk & MongoMK Series 1
AEM Persistence TarMk & MongoMK Series 2  AEM with TarMK
AEM Persistence TarMk & MongoMK Series 3  AEM with MongoMK
AEM Persistence TarMk & MongoMK Series 4  TarMK Vs MongoMK
Read More
Rule Engine integration with AEM

Subscribe Our YouTube Channel Here.

AEM With TarMK - Options

We can have 3 types of TarMK configurations for AEM Oak Clusters.

1) Single TarMK Instance

A single TarMK instance runs on a single server. For Author instances, this is the default deployment method.

Major advantages are,

• Simple
• Easy to maintain
• Better performance

The disadvantages:

• Scalability is within the limits of server capacity
• No failover capacity

2) TarMK Cold Standby

Here single TarMK instance acts as the primary instance & the repository from the primary is replicated to a standby, which acts as failover system.

Major advantages are,

• Simplicity
• Maintainability
• Performance
• Failover

The disadvantages:

• Scalability is within the limits of server capacity
• There is a manual task involved in detecting failure and failover to start working

3) TarMK Farm

Multiple Oak instances are involved and each Oak instance is running with one TarMK. All TarMK repositories are not in sync
TarMK Farm is the default deployment for publish environments.

Major advantages are,

• Performance
• Scalability for read access
• Failover

Final notes:
Always remember this. Adobe highly recommends TarMK as the default persistence technology for both the AEM Author and Publish instances, except in the use cases outlined here.
Videos on AEM & Persistence
AEM Persistence TarMk & MongoMK Series 1
AEM Persistence TarMk & MongoMK Series 2  AEM with TarMK
AEM Persistence TarMk & MongoMK Series 3  AEM with MongoMK
AEM Persistence TarMk & MongoMK Series 4  TarMK Vs MongoMK
Read More
Rule Engine integration with AEM

AEM Microkernels - MongoMK vs TarMK

Latest AEM comes with Oak storage. Oak(Apache Jackrabbit Product) is a new JCR implementation with a completely new internal architecture.
There are two options for the AEM persistence layer back-end used by Oak : TarMK and MongoMK. Let us see the scenarios where each one is feasible and what are all the main differences.


TarMK Vs MongoMK

Adobe recommendation says we must consider MongoMK when we come across below metrics

• Number of named users connected in a day: in the thousands or more.
• Number of concurrent users: in the hundreds or more.
• Volume of asset ingestion per day: in hundreds of thousands or more.
• Volume of page edits per day: in hundreds of thousands or more (including automated updates via Multi Site Manager or news feed ingestion for example).
• Volume of searches per day: in tens of thousands or more.

Prerequisites for considering MongoMK as persistence layer.

Once we identified MongoMK as persistence layer below factors are mandatory.
1. Ensure involving MongoDB architects/ Adobe MongoDB Specialists for designing the solution.
2. AEM Developers should work hand in hand with MongoDB developers to implement a successful solution.
3. For a better turn around time, always ensure to have Mongo DB Maintenance License.
4. Ensure the proposed design is validated by an Adobe Certified Experience Manager Architect to avoid any future issues.

Advantages of MongoMK in Authroing Instances

Horizontal Scalability Support – MongoMK supports multiple AEM instances share the same MongoDB instance.
Efficient Data Replication – MongoMK effectively delegates replication functionality to the MongoDB, which has mature model to maintain replica sets. Major advantage here is MongoDB replicas and AEM instances are independent each other.
Distributed Authoring Team Support – Content authoring across different geographical regions are supported by Mongo MK. At first data gets saved int the primary MongoDB and then gets replicated to the secondary DB replica sets.
Automated Failover Recovery – MongoDB supports automated failover. The efficient configuration can helps in automated system recovery from data center failure.

Advantages of TarMK in Publish Instances
Automated Failover Recovery - Efficient configuration of TarMK provides Automated recovery during system failures.
24/7 availability: Code changes are released on one data center, validate the release and then release it to the other data center. TarMK supports such rolling release efficiently.
Efficent upgrades: AEM Upgrades and patch fixes needs rolling release, thus TarMK provides better support.

Huge Data considerations: Which one to use?
If most of the Data in (TB) are binaries, TarMK is a good fit, and a data store on the file system. If the data (in multiple TB) is structured content / nodes, MongoMK is the better choice because we can shard the data.

Sharding can be found at MongoDB Documentation : Overview / Adobe Experience Manager 6.0 / Deploying and Maintaining / or The MongoDB Manual.

Final Notes:
TarMK is optimized for single node performance whereas MongoMK is designed for scalability and clustered deployments. Another factor is the volume of the data. Also keep in mind MongoMK setup/configuration/maintenance requires additional knowledge about MongoDB.

In my next blog I will be talking about MongoMK Recommended Deployments(AEM on MongoDB )
Videos on AEM & Persistence
AEM Persistence TarMk & MongoMK Series 1
AEM Persistence TarMk & MongoMK Series 2  AEM with TarMK
AEM Persistence TarMk & MongoMK Series 3  AEM with MongoMK
AEM Persistence TarMk & MongoMK Series 4  TarMK Vs MongoMK
Read More
Rule Engine integration with AEM

Subscribe Our YouTube Channel Here.

Hybrid Content Management(HCM) & AEM

Hybrid Content Management system integrates cloud storage, content management services and/or features with on-premises content management software for store, share and manage enterprise content. Some of the decision factors which involved for selection of Hybrid Content Management are cost, mobility and new features.

Importance of Hybrid Content Management
Some of the recent data analyst group study revealed that within few years, majority of enterprises will manage the content using a hybrid storage model. This showcases the importance of new Hybrid AEM designs.



EFSS
Cloud file sharing is one of the factor that can drive hybrid CMS demand with AEM. Enterprise file sync and share services (EFSS) examples are Box, Dropbox, Citrix ShareFile, Office 365, G Suite.

Majority of companies are moving to a cost effective cloud based system, but factors of security are still a concern and some of the federal data laws asks for an on-premise storage(compliance, performance related, and security restrictions). Hybrid approach of synchronizing such existing on-premises storage with new EFSS services is ideal in this case, this shows the importance of Hybrid Content Management system.

Some of the laws which asks for a secure data system:
Health Insurance Portability and Accountability Act (HIPAA), the Sarbanes-Oxley Act (SOX), the U.S. Securities and Exchange Commission (SEC) and other compliances.

Hybrid cloud services(HCS)
Hybrid cloud services, a bridge between on-premise storage infrastructure and the cloud of choice, allowing customers to scale cloud storage as needed, use a blend of private and public clouds, and maintain control of their data with simple management tools. New AEM designs asks for this type of service integrations.

Example for HCS system: NetApp's Data ONTAP - storage operating system, can be used to connect Amazon S3 or EVS storage.

Synchronization
When we migrate the applications or data to a new system , common set of problem arises such as disruption of business operations, data loss and transitioning users to new processes.

When platforms are synchronized, content is automatically populated in the new system. Through Synchronization, users can still securely collaborate with external parties and across multiple devices. Synchronization helps to sync EFSS services to their existing platforms while preserving past investments and keeping their IT infrastructure intact.

Think before you act

There are some factors to be considered before we sync up AEM with hybrid systems. Our design should be based on the out come of below considerations.

1) Ensure  bi-directional sync : When you plug AEM into a hybrid system, ensure a bi-directional sync, this confirms both platforms are up-to-date.

2) Define an inter-operability :
Consider synchronization of user permissions, document versioning and metadata across systems so that the connection is seamless, secure and transparent to end-users.

3) Think Investments done & reduce cost :
Organization might have done huge investments on the existing system already. So consider this while defining the hybrid approach. Based on usage, sync only their most used active content, while keeping old data and archived information within premise & decommission aging servers.

4) Study the system
Do an impact study on the existing system and their rules like metadata, permission, user accounts management etc. Based on the study define the new hybrid approach.

Queries?
Let us know through the comment section

Ensuring the delivery & maintenance of an effective customer experience application through AEM

An effectively built AEM application can improve the revenue of a site remarkably. Some times it is seen that sites are delivered once, and not much improvements done later on or abandoned completely.

Right team mix for improving the application
Combining Targeting team and analytic team, an AEM site performance can be improved. The data/insight can be converted to make the site more powerful. To do this we have to have a vision for the improvement.

Digital Strategy/Vision

Ensuring effective targeted results, personalized experiences can be a good way to define the strategy. A right mix of various teams like service, sales and then enabling them for digital activation & engagement found most helpful in various scenarios. You need to be Agile - Think big, start small, acting fast.

How do we create a world class digital application? How do we mix the things in right blend?

1. Aim of maximizing search efficiency utilizing the tools like test & targeting -  for a better user search and engagement.
2. Commercial focus - Study the trend and incorporate in to the application.
3. Cross channel integration - Integrate with all possible channels.
5. Customer focus - Utilize test & target to improve content/ right content, improve application context.
6. Data & insights driven - Run your tests based on data for different campaign, different segments, different audience, different device, location on different device.
7. Continuous improvement - Continuous testing in 'multiple onsite location with various experiences'; possibly an in person testing. Try out various campaigns, promotions etc.
8. Optimize - Engage users(internal, external) in surveys and capture the data for further improvements - optimize.
8. Geo-location Consideration - serve the user based on his Geo, language and right content.
9. Use tool based improvement : machine based learning, automation etc

There are some ways to achieve continuous improvement and optimization.

Targeting -

• On various Geo location, languages
• On various device types
• Various products like desktop app, mobile app,promotions etc.
• Search - combine the test and target approach

Testing -

• Creative - Effective UI testing
• Promotion & offers - Geo location/ user specific based validations
• Layouts - on desktop, mobile etc.
• Segments - User segments
• CTA's - Each and every CTA's

Dispatcher - Some points to remember

Dispatcher 

• Dispatcher is a caching and load balancing tool for AEM.
• Dispatcher acts as a firewall and helps to protect site from vulnerable attack.
• Dispatcher is used in conjunction with a standard web server.

Why Caching & when caching does not work?
Any site performs well when it is served from a cache. Except dynamic data, everything else is recommended to be cached. There are cases where the caching does not work. For eg, get() request, when query parameters are available or no extension, response.setHeader("Dispatcher", "no-cache"), authentication header/cookie or any other cases where the dispatcher rules are not satisfied.

Better ways of serving dynamic content?
While AEM site implementation, the main aim would be caching all site content. When there are content to be served dynamically, we have to serve them through RESTFul service (Page Layout is still cached).

Dispatcher Vs CDN
CDN (Content Delivery Network) is globally distributed and serves request across balanced regions. But AEM Dispatcher resides with AEM and not globally distributed.

Cache invalidation from dispatcher

Below mentioned methods are common in invalidating cache from dispatcher.

From authoring

A replication agent is configured on the AEM author instance, which sends a cache invalidation request to Dispatcher when a new page is published. This invalidates the cache from authoring environment.

From publishing

In this scenario the publishing environment sends a cache invalidation request to Dispatcher when a published page is received.

Manual

There are cases when dispatcher cache needs to be invalidated without activation of a page. Such cases we can issue an HTTP request to the dispatcher. The HTTP request delete specific files from the Dispatcher cache.

Read More

Steps to implement any search technology
AEM Dispatcher, why it  is needed?
AEM Desktop App
Figure out the best search technology or tool
Steps to implement search in Solr
Quality of Search - fine tuning search implementation

HTL

HTL Intro
HTL Syntax
HTL Options
HTL Variables
HTL Literals
HTL Operators
HTL Use-API

Adobe Experience Manager (AEM) Desktop App installation

AEM Desktop app maps the AEM Assets to a network directory. This helps to view the AEM assets in Windows/Mac Explorer/Finder. The assets can also be edited using various image-editing apps. All changes are reflected immediately in AEM Assets and gets synced quickly.

Which version of OS supported by AEM Desktop App?
At present the Windows(Version 7 and 10) and MacOSX(10.10 or later)

Where to get installer?
Go to helpx.adobe site and access the path 'experience-manager/kb/download-companion-app.html'. Select the version which you are interested and download the app.

I am using previous version of AEM. Can I use the desktop app with older version of AEM?
AEM 6.3 supports the app directly without any service pack installations. Refer the download section for the service pack required for older version (6.2,6.1)

How does the desktop app sync the data?
AEM Desktop app saves files first in local system. Later, the upload to AEM Server happens on back end. This ensures that user is not interrupted on bigger uploads and all versions are maintained intact. There is also option to monitor the upload process using Desktop App upload monitoring dialog.

Installation steps

• Download the installer.
• Double click on .msi file (for Windows OS)

Follow the on screen instructions. (Change the drive in case if you want to install the app in other drive)

Connecting AEM Desktop App with AEM Instance
Select the AEM Desktop app from start
Enter the Connection root - your AEM Instance url > Enter 'Go'

Enter the user credentials, Sign In

On task bar we can see the AEM icon, clicking on this will give us options to work with AEM Desktop app

Options

• To see the assets of connected host, click on 'Explore Assets'
• To see any upload status, click on 'Show back ground upload queue status'
• We can also forget, disconnect current connection.
• Configuration includes , connect on application start & Launch application on startup.
• Advanced options provides log info , clear cache.

Debug AEM Desktop App installer issues

There are cases where the app will not launch after installation.

1) Ensure other apps are not running in the same port. Close any such applications.
2) Ensure the bit locker in unlocked if you are using it.

Read More

Steps to implement any search technology
AEM Dispatcher, why it  is needed?
AEM Desktop App
Figure out the best search technology or tool
Steps to implement search in Solr
Quality of Search - fine tuning search implementation