Best Practices for Optimal Results
Follow these guidelines to achieve the highest quality chatbot performance and make the most of Smartine's AI-powered web crawling features
Content Structure
• Use clear, descriptive headings and subheadings
• Organize content in logical sections
• Keep paragraphs concise and focused
• Use bullet points for lists and key information
• Include relevant keywords naturally in content
Content Quality
• Write clear, grammatically correct content
• Avoid excessive jargon or overly technical terms
• Provide comprehensive answers to common questions
• Keep information up-to-date and accurate
• Include examples and use cases
Pro Tip
Well-structured content leads to better AI understanding and more accurate chatbot responses. The AI can better extract and contextualize information from organized content.
Pages to Crawl
• FAQ pages: Essential for chatbot training
• Product/Service pages: Detail your offerings
• About pages: Company information and values
• Contact information: Support and inquiries
• Documentation: Technical details and guides
Pages to Exclude
• Login and admin pages
• Duplicate or similar content pages
• Legal documents (unless relevant)
• Image galleries without descriptions
• Archived or outdated content
Important Note
More pages mean more processing time and usage. Focus on quality content that directly benefits your chatbot's ability to answer questions.
Widget Placement
• Place chatbot in bottom-right corner (standard)
• Ensure it's visible on all pages
• Make it easily accessible but not intrusive
• Test on mobile and desktop views
• Use brand colors for consistency
Response Settings
• Set appropriate response length limits
• Use concise but comprehensive answers
• Include fallback responses for unknown queries
• Add contact information for complex issues
• Regularly review chatbot interactions
Best Practice
Test your chatbot with common customer questions before going live. Refine your content based on the quality of responses.
Regular Updates
• Re-crawl when website content changes
• Update FAQ sections regularly
• Remove outdated information promptly
• Add new products/services to crawl list
• Monitor chatbot query logs for gaps
Quality Monitoring
• Review chatbot responses weekly
• Track common unanswered questions
• Test with various query types
• Analyze user interaction patterns
• Refine content based on feedback
Maintenance Tip
Set up a monthly schedule to review and update your chatbot's knowledge base. This ensures accuracy and relevance.
Content Preparation
• Use semantic HTML structure
• Include meta descriptions and titles
• Add alt text to images
• Use schema markup when possible
• Maintain consistent terminology
Training Enhancement
• Create comprehensive FAQ pages
• Include common variations of questions
• Provide detailed, complete answers
• Use natural language in content
• Add context and examples
AI Enhancement
The AI learns from your content structure. Better organized content leads to more accurate and contextual responses.
Efficient Crawling
• Prioritize most important pages first
• Use selective crawling for large sites
• Schedule crawls during off-peak hours
• Monitor your plan usage limits
• Avoid crawling duplicate content
Cost Optimization
• Choose the right plan for your needs
• Focus on high-value pages
• Use incremental updates for changes
• Archive old or unused chatbots
• Track ROI and adjust accordingly
Efficiency Strategy
Smart resource management ensures you get maximum value from your plan while maintaining high chatbot performance.
Content Issues
• Crawling pages with outdated information
• Including too many irrelevant pages
• Using overly technical language
• Neglecting to update content regularly
• Ignoring mobile-responsive content
Configuration Mistakes
• Not testing chatbot before deployment
• Ignoring query logs and analytics
• Setting inappropriate response limits
• Not providing fallback options
• Forgetting to update API keys
Avoid These Issues
Taking shortcuts in setup or maintenance can lead to poor chatbot performance and frustrated users. Invest time in proper configuration.